Clean a database file with >30 million records

$30-250 USD

W trakcie realizacji

Opublikowano

około 9 lat temu

$30-250 USD

Płatne przy odbiorze

We got a database with with > 30 million records stored in multiple CSV-files. Before being able to import these records into our CRM, we have to clean and consolidate the data. I'm looking for a trustworthy person who can help us to a) consolidate all data in one file b) eleminate all records without a value in one particular field IDNUMBER, c) clean 2-3 fields to numbers only without loosing leading zeros, d) find and eleminate all double entries based on field IDNUMBER (this field shall become the unique identifier) e) deliver the resulting database in MYSQL-format and CSV-format

Data Processing

Identyfikator projektu: 7239697

Informację o projekcie

5 ofert

Zdalny projekt

Aktywny 9 lat temu

Szukasz sposobu na zarobienie pieniędzy?

Adres e-mail

Korzyści ze składania ofert na Freelancer.com

Ustal budżet i ramy czasowe

Otrzymuj wynagrodzenie za swoją pracę

Przedstaw swoją propozycję

Rejestracja i składanie ofert jest bezpłatne

5 freelancerzy składają oferty o średniej wysokości $123 USD dla tej pracy

@Harun1986

A proposal has not yet been provided

$45 USD w 3 dni

4,8

(28 opinii)

4,8

@Venkylancing

Hi There, good day! I have done this cleaning job in the past, i am good at excel and data handling. Will create master file with all unique records in-them. Will remove all duplicates and align the data in proper order. Am good at excel, formulas. let em knwo if i can do this for you. Thank you Anupama.

$115 USD w 3 dni

4,6

(31 opinii)

4,5

@janmsidh

Dear Sir/Madam, My bid is on higher side as I know the pain in handling huge amount of data especailly when this is excel file. I have 20 years of IT experience and mostly in Database, Oracle, Sybase, Postgresql, SQL Server and MySQL. My brief background: I spent 13 years in USA as senior DBA mostly in US federal bodies like SEC, NASA, SBA, and FCC. I have great references from them. I also worked at Citibank singapore on behalf of Nucleus software. Here is the approach which I am going to take: 1. From each excel file I will upload the data into MySQL in all text field to contain all leading zeros without any primary key. 2. Will remove all the rows with blank primary key (IDNUMBER) 3. Will move all the distinct rows in a separate table or delete the duplicate rows if I find any search criteria for the duplicate. 4. Finally will create Primarykey on the filtered rows. If index created successfully then everything should be fine. 5. Export in a file and will send the mysql database backup(dump) Appreciate your attention. Warm regards, Pranesh Sinha

$250 USD w 4 dni

5,0

(2 opinii)

2,9

@vpgopalkrishna

A proposal has not yet been provided

$45 USD w 3 dni

0,0

(1 opinia)

0,0

@poaka

I've already worked with CSV files, that means import through a PHP Script into MySQL. I'm also pretty good with this DBMS. As Software Engineer this is a very easy task for me. Ready to start ASAP !!!

$161 USD w 3 dni