Big Data Engineer

₹75000-150000 INR

Zamknięte

Opublikowano

ponad 5 lat temu

₹75000-150000 INR

Płatne przy odbiorze

What do we do at BluePi: BluePi is a born in cloud organization with one of the main focus area being Big Data and Analytics. At BluePi we solve different business problems for clients from different industrial domains like Media, Retail, Logistics, Clothing, etc. At Bluepi we build, develop and deliver big data solutions including ETL, Data warehousing, DataLake, BI and Analytics using various technologies of hadoop ecosystem and other distributed computing frameworks like Storm, Flink, etc. Roles and Responsibilities: As a Big Data Engineer at BluePi, you will : 1. Integrate with different data sources to collect and process and transfer data in realtime and batch using different Big Data tools and frameworks. 2. Setup Pipeline for ingesting data in Realtime and Batch using tools/frameworks like kafka, Kinesis, DMS, Data Pipeline etc. 3. Write ETL processes using various tools/ frameworks like Spark, Storm, Talend, Glue, etc in Java/Python/Scala 4. Integrate with different databases like Hadoop ecosystem (like Hive, Impala, HBase, etc.), Redshift etc. 5. Setup data lake on S3 or similar storage services. Skills Required: 1. 3+ years of Hands-on experience on Big data tools and frameworks. Experience on Hadoop ecosystem, integrating and implementing solutions using technologies like - Hive, Pig, Mapreduce, HDFS etc. 2. Should have a proficient understanding of distributed computing paradigm and realtime processing vs batch processing paradigm. 3. Should be proficient in designing and implementing Dimensional models and Data Marts. 4. Should have an experience in writing ETL processes and connect to different data sources using different mediums/technologies. 5. Proficient in at least one of the following programming language - Java, Python, Scala. 6. Experience in AWS EMR/Redshift/Glue would be an added advantage.

Identyfikator projektu: 17856423

Informację o projekcie

8 ofert

Zdalny projekt

Aktywny 5 lat temu

Szukasz sposobu na zarobienie pieniędzy?

Adres e-mail

Korzyści ze składania ofert na Freelancer.com

Ustal budżet i ramy czasowe

Otrzymuj wynagrodzenie za swoją pracę

Przedstaw swoją propozycję

Rejestracja i składanie ofert jest bezpłatne

8 freelancerzy składają oferty o średniej wysokości ₹129 583 INR dla tej pracy

@deytps86

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MOngoDB, Postgre. I implemented above using Java Scala and Python. Have worked Shell, Perl and Python Even my last consecutive 6 projects are in Spark. Can we talk further on this? Thank you!

₹125 000 INR w 30 dni

4,9

(30 opinii)

6,3

@eaglepoint

Hi I am data engineer with 3+ years of industry experience. I am certified aws solution architect as well. I have been working on deploying highly scalable, available and fault-tolerant big data solutions using both clouds and on commodity. I have expertise in following areas. 1. Building spark pipelines using python, glue, aws emr, and data pipelines. 2. Data ingestion using sqoop, flume, kafka. 3. Data driven workflows automation using Nifi, Kylo(Teradata Data lakes solutions) 4. Adhoc reporting solutions using aws Athena, hive in EMR 5. Hortonwork HDP and HDF, Cloudera Distribution 6. DevOps implementation in data lakes and data warehousing solutions using docker and Jenkins I can do this job for you, if you can give me an opportunity to verify my expertise. I will sure timely delivery with quality and budget. looking forward to hearing from you

₹125 000 INR w 30 dni

5,0

(8 opinii)

4,7

@dineshrajputit

Hi, I have 7 years of experience and working on hadoop, spark, nosql, java, cloud, aws,gcp, Azure... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

₹75 000 INR w 30 dni

5,0

(8 opinii)

4,1

@dirisalagopal

big data expert

₹111 111 INR w 1 dzień

5,0

(3 opinii)

3,6

@suraj43

Hello We are group of freelancers working extensively on Data Warehousing, ETL, Data Mining, Data Analytics, Product Development and deployment on cloud, Machine Learning, Deep Learning and Microservices. After excelling our skills for more than 7 years in these fields and services, now we have formed a group of freelancers who work collaboratively on array of technologies. We have worked on all the mentioned tech stack and have hands on experience working with ETL, Data warehousing, DataLake, BI and Analytics using various technologies of hadoop ecosystem and other distributed computing frameworks like Storm, Flink, etc. We are currently working on Data warehousing for Pharmaceuticals Industry where we need to collect and analyze data and come up with results like which particular area is having which particular disease most often. For this we are using Python as Scripting Language, Hive as RDS and AWS environment. We are processing the data in Spark and developing dashboard in Kibana for Data Analysis. We are dedicated team of freelancers having excellent project management skills and altruistic approach towards clients. We truly look forward to work with you. Thank You.

₹125 000 INR w 30 dni