ETL Powercenterprojekty

Celem projektu jest migracja danych(kilkudziesięciu tabel) z kilku systemów klasy ERP do hurtowni danych w Azure. Narzędziem ETL ma być Azure data factory. Dodatkowym wymaganiem jest stworzenie architektury hurtowni i odpowiednie zabezpieczenie danych.

Celem projektu jest zbudowanie hurtowni danych wraz z architekturą i procesami zasilającymi ETL (Data factory). Zasilenia wymaga 30 tabel pochodzących z systemów ERP. Dodatkowo w projekcie powinno być przewidzianie: -szkolenie z utrzymania Data factory i servera.

Witam Chcialbym zlecic Na srodowisku MS SQL 2008 trzeba z gotowego zapytania utworzyc baze danych Do utworzonych tabel trzeba eksportowac dane ktore znajda sie w plikach tesktowych, trzeba jest je poprawnie zaladowac bo zawieraja bledy. Dla tych danych trzeba zaprojektowac proces ETL, wybrac odpowiedni model hurtowni i wymiary. Nastepnie dla tej hurtowni zbudowac kostke OLAP i zdefiniowac dla niej dwa raporty.

- Implementacja Bazy Ms Sql - Import danych i zbudowanie porcesu ETL - Zaprojektowanie hurtowni danych(model,wymiary, fakty) - Projekt kostki i dwa raporty

- Implementacja Bazy Ms Sql - Import danych i zbudowanie porcesu ETL - Zaprojektowanie hurtowni danych(model,wymiary, fakty) - Projekt kostki i raporty

- Implementacja Bazy Ms Sql - Import danych i zbudowanie porcesu ETL - Zaprojektowanie hurtowni danych(model,wymiary, fakty) - Projekt kostki i raporty

Zlecę wykonanie " Jest to projekt na studia zaliczeniowy, projekt polega na tym ze sa 3 nazwiska z imionam...okres, czy są to dane rzeczywiste itd.) 3. Hurtownia danych 3.1. Model pojęciowy hurtowni - Jakie analizy chcecie prowadzić, jak to się przekłada na fakty i wymiary; całość opisana językiem naturalnym; - Opis pojęć 3.2. Model logiczny hurtowni, czyli ERD w Visio 3.3. Model fizyczny hurtowni, skrypty zakładające w SQL Server struktury w bazie „DWH_IWB” 4. ETL do własnej bazy źródłowej; jako bonus – utworzenie procesu ETL do baz innych zespołów 4.1. Tabela z mapowaniem danych 4.2. Projekty SSIS 4.3. Opis przepływu danych 5. Kostki OLAP 5.1. Projekt SSAS 5.2. Opis kostek OLAP Cena do uzgodnienia oraz ...

Zlecę wykonanie 2. Baza źródłowa 2.1. Model logiczny bazy danych 2.2. Plik bazy danych (Access) 2.3. Pr...okres, czy są to dane rzeczywiste itd.) 3. Hurtownia danych 3.1. Model pojęciowy hurtowni - Jakie analizy chcecie prowadzić, jak to się przekłada na fakty i wymiary; całość opisana językiem naturalnym; - Opis pojęć 3.2. Model logiczny hurtowni, czyli ERD w Visio 3.3. Model fizyczny hurtowni, skrypty zakładające w SQL Server struktury w bazie „DWH_IWB” 4. ETL do własnej bazy źródłowej; jako bonus – utworzenie procesu ETL do baz innych zespołów 4.1. Tabela z mapowaniem danych 4.2. Projekty SSIS 4.3. Opis przepływu danych 5. Kostki OLAP 5.1. Projekt SSAS 5.2. Opis kostek OLAP Cena do uzgodnienia ora...

Witam, mam do zlecenia wy...Data Tools - Business Intelligence for Visual Studio 2012, który będzie spełniał poniższe kryteria. Projekt nie musi być skomplikowany, ma umożliwić zaliczenie przedmiotu. Projekt ma polegać na: 1. Znalezieniu lub wygenerowaniu źródeł danych, które można analizować. 2. Stworzeniu modelu hurtowni danych (preferowany schemat gwiazdy) 3. Założeniu bazy danych hurtowni 4. Przygotowaniu procesów ETL w narzędziu Integration Services 5. Przygotowaniu kostki w narzędziu Analysis Services 6. Przygotowaniu raportów w narzędziu Reporting Services Narzędzia na podstawie których ma być wykonane zlecenie: MS Visual Studio 2012 MS SQL Server 2012 Enterprise SQL Server Data Tools - Business Intelligence for Visua...

Witam, mam do zlecenia wykonanie projektu w narzędziu MS Visual Basic który będzie spełniał poniższe kryteria. Projekt nie musi być skomplikowany, ma umożliwić zaliczenie przedmiotu. Projekt ma polegać na: 1. znalezieniu lub...zlecenia wykonanie projektu w narzędziu MS Visual Basic który będzie spełniał poniższe kryteria. Projekt nie musi być skomplikowany, ma umożliwić zaliczenie przedmiotu. Projekt ma polegać na: 1. znalezieniu lub wygenerowaniu źródeł danych, które można analizować. 2. Stworzeniu modelu hurtowni danych (preferowany schemat gwiazdy) 3. Założeniu bazy danych hurtowni 4. Przygotowaniu procesów ETL w narzędziu Integration Services 5. Przygotowaniu kostki w narzędziu Analysis Services 6. Przygotowaniu raportów w...

Firma PMR z Krakowa poszukuje osoby, która posiada dobrą znajomość pracy z narzędziem ETL firmy Pentaho. Zlecenie dotyczy wdrożenia rozwiązania ETL Pentaho dla 10ciu wybranych plików excel i html.

Firma PMR z Krakowa poszukuje osoby, która posiada dobrą znajomość pracy z narzędziem ETL firmy Pentaho. Zlecenie dotyczy przeszkolenia grupy osób z ETL Pentaho.

Poszukujemy dla Naszego Partnera w/w osobę do 3 - miesięcznego projektu w Warszawie. Branża Telekomunikacyjna. Umiejętność programowania w SQL, PL/SQL, procesy ETL, bazy danych, tematyka finansowo /bilingowa. Czekamy na CV, gdzie należy przedstawić m.in. obszar/technologia, znajomość w skali 1-5 oraz gdzie używany, stawka brutto za 1 godz. Pozdrawiam e-mail: info@

* Znajomość oraz co najmniej 3-letnie doświadczenie w pracy z bazami danych Oracle 10g lub nowszej wersji * Doskonałe zdolności zarządzania dokumentacją i wiedzą * Doświadczenie w pracy z technologiami hurtowni danych (Data Warehousing), w szczególności optymalizacja, tuning i kontrola procesów ETL oraz utrzymanie w środowisku produkcyjnym * Znajomość Business Objects * Doświadczenie w określaniu koncepcyjnych i fizycznych modeli danych * Doświadczenie w zakresie analiz biznesowych i gromadzenia wymagań * Znajomość Oracle Warehouse Builder

* Znajomość oraz co najmniej 3-letnie doświadczenie w pracy z bazami danych Oracle 10g lub nowszej wersji * Doskonałe zdolności zarządzania dokumentacją i wiedzą * Doświadczenie w pracy z technologiami hurtowni danych (Data Warehousing), w szczególności optymalizacja, tuning i kontrola procesów ETL oraz utrzymanie w środowisku produkcyjnym * Znajomość Business Objects * Doświadczenie w określaniu koncepcyjnych i fizycznych modeli danych * Doświadczenie w zakresie analiz biznesowych i gromadzenia wymagań * Znajomość Oracle Warehouse Builder

* Znajomość oraz co najmniej 3-letnie doświadczenie w pracy z bazami danych Oracle 10g lub nowszej wersji * Doskonałe zdolności zarządzania dokumentacją i wiedzą * Doświadczenie w pracy z technologiami hurtowni danych (Data Warehousing), w szczególności optymalizacja, tuning i kontrola procesów ETL oraz utrzymanie w środowisku produkcyjnym * Znajomość Business Objects * Doświadczenie w określaniu koncepcyjnych i fizycznych modeli danych * Doświadczenie w zakresie analiz biznesowych i gromadzenia wymagań * Znajomość Oracle Warehouse Builder

...effort. If your work is good, we can continue the rest of the stages! Key Requirements: - Data Integration: The main task is to bring in public datasets and integrate them into the data warehouse. - Reporting & Visualization: The data warehouse primarily serves as a hub for reporting and data visualization using Microsoft Power BI. Ideal Skills and Experience: - Proficient in data integration and ETL processes. - Experience with public datasets. - Advanced knowledge of Microsoft Power BI. - Solid understanding of the business needs behind data warehousing. What exactly I will need you to deliver in the 1st stage: -EXPECTATIONS AND DETAILED NEEDS FOR DECISION SUPPORT -SCOPE OF ANALYSIS – ASPECTS EXAMINED -DATA SOURCES -LOCATION, FORMAT, AVAILABILITY -DATA SOURCE BASIC...

...Engineer to step in and effectively collaborate with my remote team. Given the lack of a specific task or main goal, your expertise, adaptiveness, and versatility will come in handy. Key responsibilities may likely include: - • Ideal candidates should have strong experience with Azure Databricks and Data factory. • Conducting data analysis - Data integration - Data processing - Possibly executing ETL processes - Maybe venturing into data modelling, optimization, and pipeline development. • Efficient communication and collaboration capabilities are needed for this remote role. • I look forward to working with an adaptable professional who can confidently handle diverse tasks in Azure data engineering. • Design, develop, and maintain data pipelines ...

I am looking for a skilled freelancer, adept in ETL (Extract, Transform, Load) operations. In this project, your task will be to extract CSV files from an SFTP server and load them onto a SharePoint Document Library. Key responsibilities: - Source the data from the SFTP server. - Ensure accurate and smooth extraction of CSV files. - Successful Load of the data to SharePoint Document Library. Ideal candidate skills and experience: - Solid background in ETL operations. - Prior experience with SFTP servers. - Proficiency with working CSV files. - Familiarity with SharePoint Document Library.

...algorithms Proficiency in data integration and ETL processes Familiarity with MongoDB and data storage + M365 Integration Strong analytical and problem-solving skills Excellent communication and documentation skills Task Breakdown: Develop a fuzzy matching module to compare data across 15-20 points of data Implement additional matching algorithms (e.g., exact matching, regex pattern matching) to handle various data formats Develop 15*3 ETL processes to handle different data formats and request codes Integrate the developed modules with our Azure/M365 environment Configure data storage, authentication, and authorization Perform thorough testing and debugging of the developed modules and ETL processes Deliverab...

I need a Python developer who can handle automation tasks related to ETL pipeline, data extraction from Snowflake, and a dbt environment. Key Requirements: - You should be proficient in Python programming. - Be familiar with the Window Task Scheduler. - Have experience with ETL pipeline development. - Know how to extract data from Snowflake and a dbt environment. The Purpose: - The ETL pipeline is crucial for handling data analysis, reporting, and data integration tasks. - The data size to be processed in the ETL pipeline is medium, up to 10 GB. Ideal Candidate: - You should have prior experience in handling similar tasks. - A strong understanding of data handling and automation through Python and ETL tools. - Proven expertise in data extraction from...

...ensuring accuracy and consistency. - Data Modeling: The ideal candidate should have a deep understanding of how to organize data in a way that supports business needs and decision-making. - ETL Processes: The selected freelancer will be responsible for the extraction, transformation, and loading of data into our warehouse. We are working with a medium-sized dataset (1-10 terabytes), so we need someone who is not only experienced in data warehousing but also with datasets of this size. Ideal Skills and Experience: - Proven track record in data warehousing, with a focus on data integration, data modeling, and ETL processes - Experience working with medium-sized datasets (1-10 terabytes) - Excellent analytical and problem-solving skills - Strong communication skills to eff...

I'm in need of a data processing expert who can assist me in developing an architecture to analyze knowledge graphs using ETL and machine learning. Key Tasks: - Leveraging Data Processing Expertise: I need someone with a strong background in data processing, particularly in relation to graph technologies. Your role will be to harness this knowledge to create an efficient and effective architecture for analyzing knowledge graphs. Ideal Skills and Experience: - Strong Data Processing Background: A deep understanding of data processing is crucial for this project, particularly in the context of graph technologies. Experience in working with large datasets and complex data structures is highly desirable. - Familiarity with Graph Technologies: Knowledge of graph databases and asso...

I'm in need of a data processing expert who can assist me in developing an architecture to analyze knowledge graphs using ETL and machine learning. Key Tasks: - Leveraging Data Processing Expertise: I need someone with a strong background in data processing, particularly in relation to graph technologies. Your role will be to harness this knowledge to create an efficient and effective architecture for analyzing knowledge graphs. Ideal Skills and Experience: - Strong Data Processing Background: A deep understanding of data processing is crucial for this project, particularly in the context of graph technologies. Experience in working with large datasets and complex data structures is highly desirable. - Familiarity with Graph Technologies: Knowledge of graph databases and asso...

I'm looking for a skilled data engineer to help me with the OMOP ETL process. Your main responsibilities will be: - Extracting and transforming data: You'll be working with me to extract data from a data warehouse and transform it into the OMOP CDM. - Loading data into a database: After transforming the data, it will need to be loaded into a PostgreSQL database. Experience with ETL processes and PostgreSQL is critical. You should also be familiar with data validation checks, as we need basic data type and range checks applied during this project. You must have experience loading data into the OMOP CDM.

I'm looking for an AWS Glue expert to handle my large MySQL database, over 10GB, and write it to S3. You will need to have: - A strong understanding and experience in handling large databases. - Proficiency in using AWS Glue for data ETL processes. - Knowledge in determining the best strategy to quickly load large amounts of data. - Experience working with Parquet output format. The database gets updated daily, so a fast and efficient process is required to ensure optimal performance. Please detail your experience with similar projects when making your bid.

I'm seeking a proficient Power BI expert who can help me create ...BigCommerce, Google Adwords, and Google Sheets - Metrics to Track: Sales revenue, Website traffic, Customer acquisition cost, Inventory levels, and Gross Margin - Update Frequency: Daily Ideal Skills and Experience: - Proficient in Power BI; capable of integrating various data sources seamlessly - Experience in creating dashboards and reports for Sales, Marketing, and Inventory data - Strong knowledge of ETL processes and data visualization techniques - Ability to automate data refresh on a daily basis Your deliverable will be a fully functional and automated Power BI dashboard that visualizes the mentioned metrics accurately and succinctly, providing me with real-time insights into the health and performance ...

As the professional handling this project, you'll engage with big data exceeding 10GB. Proficiency in Python, Java, and Pyspark are vital for success as we demand expertise in: - Data ingestion and extraction: The role involves managing complex datasets and running ETL operations. - Data transformation and cleaning: You'll also need to audit the data for quality and cleanse it for accuracy, ensuring integrity throughout the system. - Handling Streaming pipelines and Delta Live Tables: Mastery of these could be game-changing in our pipelines, facilitating the real-time analysis of data.

I am seeking a skilled data engineering trainer, speed in using Hadoop, Apache Spark, and SQL is paramount. Your expertise will guide me through nuanced uses of these technologies, with a particular focus on data migration. Key Requirements: - Proficiency in Hadoop, Apache Spark, and SQL - More than 10 hours availability weekly - Proven experience in real-world data migration projects Ideal candidates should have a flair for explaining complex concepts in simple language. This engagement will focus on moving data from diverse sources into a data warehouse, thereby making it readily available for business intelligence functions.

As a client, I'm seeking a Python developer who that can help me trasforming data. The primary source of the data will be company-related information. Ideal Skills and Experience: - Proficiency in Python - Extensive experience in data analysis, particularly with telecomdata - Familiarity with APIs for data collection - Knowledge of telecom - Ability to understand Python appl...experience in data analysis, particularly with telecomdata - Familiarity with APIs for data collection - Knowledge of telecom - Ability to understand Python application and python scripts -Know about Airflow , Spark, Kafka, Transaction Mysql Key Requirements: - Develop a Python program that can efficiently trasform non useful to useful data. - Strong understanding of telecom data -Spark sessions, ETL...

...and analysis, within a short timeframe. - Entity-Relationship Modeling: Develop and finalize a comprehensive ER diagram that illustrates the database structure and supports urgent marketing analytics requirements. - Efficient Data Export and ETL Processes: Set up and manage the rapid export of data from various platforms using APIs. Develop and implement ETL (Extract, Transform, Load) processes to clean, transform, and load data into the database swiftly. - Documentation: Produce concise and clear documentation on the data architecture, ER diagrams, and ETL processes to support ongoing maintenance and scalability. - Collaborative and Rapid Execution: Work closely with the project manager and other team members to ensure alignment of the database design with business...

• Experience with Testing tools Experienced using SQL Advanced experience developing test metrics and reports Experience with Automated Testing Five (5) • years of Testing experience in a Software Development Lifecycle environment Five (5) • SQL and PLSQL Programming in SQL Server ETL and Data warehouse process Informatica 10 • 20 Informatica Data Quality Profiles , Score Cards SQL Server RDBMS SQL Server Analytics Services SSAS SQL Server Reporting Services SSRS Tableau Reporting BMC Control M Scheduler Tool Data Analysis Data Profiling Application Life Cycle Management Complete Testing process SDLC, Agile Process, SAFE and Kanban methodologies, TFS Tool Good Communication Skills and Quick Learner Selenium Automation Unix Finance Domain Knowledge Automation Scri...

As an ETL Expert Data Engineer with Airflow expertise, I require a professional who can take on a sophisticated data integration task. Key Responsibilities: - You will be responsible for data integration. - The data will be pulled from various APIs. - The processing logic required is advanced, aimed at facilitating analytics and machine learning. You should possess: - Extensive ETL experience. - Deep knowledge of Apache Airflow. - Proven track record in handling complex data integration tasks. - Capability in building data pipelines for advanced analytics. - Familiarity with APIs, ensuring efficient data extraction. - Strong problem-solving skills and attention to detail. I am looking for someone who can take this project and deliver high-quality results promptly.

...in data migration across CRP, SIT, UAT, and GoLive phases in Oracle Fusion ERP implementation, utilizing ETL tools. * Experience in SQL Server, T-SQL, and SSIS Job Responsibilities: Data Extraction: * Extract data from various source systems, including flat files, spreadsheets, legacy databases, and external APIs. * Develop and optimize SQL queries and scripts for efficient data retrieval. Data Transformation: * Perform data cleansing, validation, and transformation to ensure data quality. * Convert data from source formats to Oracle-compatible formats. * Apply business rules and data mapping for aligning source data with target data structures. ETL Development: * Develop and maintain ETL (Extract, Transform, Load) processes using standard tools. * Handle data integ...

Job Title: Senior Master Data Management (MDM) Developer Monday to Friday Remote via Zoom 2-3 hours/day IST Night (7pm to 12amIST) Salary: 30,000 INR per mont...Monday to Friday Remote via Zoom 2-3 hours/day IST Night (7pm to 12amIST) Salary: 30,000 INR per month We are seeking a Senior Master Data Management (MDM) Developer with a focus on healthcare. Strong SQL skills for data manipulation and querying. Experience with ETL development and integration. Familiarity with Azure Data Factory and cloud/on-prem migrations is advantageous. One needs to be available in the mentioned timings and willing to work by screen share and remote control via Zoom. Skills Required: Master Data Management (MDM) ETL development and integration Strong SQL skills SSIS Azure Data Factory Cloud/o...

As a client, I am in search of a skilled Python developer with experience in XML parsing and handling database operations. I require a Python utility program to parse Talend jobs and determine source and target column details. Key Requirements: * Parse XML files - The Talend mapping file will be supplied in XML format. We're in need of someone fluent with Python's X...or potentially other formats. It should be flexibly designed as we will use this data to load into a database. * Database expertise - An understanding of database interactions and structure are vital. This project will require both a keen eye for detail and the ability to create efficient, effective code. The utility must be well-documented and easy to maintain. Experience with Talend or other ETL tools wo...

I'm constructing a robust real estate scoring model, and need a skillful database engineer proficient in Google Big Query. The project involves: 1. ETL Development: Your main task is to develop an ETL process. You should have experience managing CSV files and integrating APIs. 2. Data Management: The data to handle includes property addresses, sale price history, property characteristics, and people details related to properties. The expert should know how to organize and manage this huge amount of data effectively. 3. Real-Time Updates: Due to the volatile nature of the real estate market, the ability to integrate real-time updates is an asset. An expert in Google Big Query, effective in handling CSV files, and capable of seamless API integration would make the best f...

I'm in search of a Azure Data Factory expert who is well-versed in Delta tables, Parquet, and Dedicated SQL pool. As per the requirement, I have all the data and specifications ready. The successful freelancer will need to be familiar with advanced transform...in search of a Azure Data Factory expert who is well-versed in Delta tables, Parquet, and Dedicated SQL pool. As per the requirement, I have all the data and specifications ready. The successful freelancer will need to be familiar with advanced transformations as the ETL complexity level is high. It's a plus if you have prior and proven experience in handling such projects. Key Skills Required: - Expertise in Azure Data Factory - Deep knowledge of Delta tables, Parquet and Dedicated SQL pool - Familiarity with adv...

Job Description: Develop & support Power BI artefacts and participate in the analytics product development Participate in the analysis of requirements to understand the business and system needs regarding user interfaces, reporting enhancements, new functionality, and back-end ETL operations, should be able to provide estimates against requirements. Code and modify reports using DAX & MDX programming languages. Document all code using standard forms and procedures, adhering to all naming conventions Participate in unit, system, and user acceptance testing Adopt new and emerging technologies to provide solutions to client needs. Additional responsibilities will be team performance management, timesheet reviews, ensuring project delivery on time. Required Primary Skills: ...

"Airflow pipeline I require a professional with experience in Airflow and dbt for my project. You will be handling an ETL/ELT integration specifically for data migration. This migration task involves moving specific tables from one MySQL database to another one. I'm trying to migrate data from mysql to mysql. We need to transfer incremental data on an hourly basis. We are looking to use open source ETL or ELT. In addition to airflow, you can use other open source ETL tools.".

...to be connected to Azure; this is contract management system. 2. One more company recently which was acquired has financial data on-prem on different tenant we need to bring in this data to the Azure cloud. Note : Business central is for the financial data and GL entry ,Dynamics 365 is for the sales and invoicing ,Hubspot for the sales lead, Service Now is the ticketing system , Workato is the ETL tool which connects all the system,Kimble one is the project management platform. There is one billing system acquire going on we might need to bring in the data from this source also. Data Handling: Perform necessary data normalization or transformation before storing the data in Azure SQL Database. The ideal candidate for this role will have past experience with Azure SQL Database...

...with experience in Airflow and dbt for my project. You will be handling an ETL/ELT integration specifically for data migration. This migration task involves moving specific tables from one MySQL database to another one. Your key responsibilities for this project will include: - Identifying the specific tables needed for migration, as indicated by me. - Developing and implementing an efficient migration process using Airflow and dbt. - Ensuring successful and accurate data migration. Ideal skills: - Incremental data must be transferred every hour. - Transfer speed is important. - Extensive experience in Airflow & dbt. - Proficient in MySQL databases. - Experience in data migration projects. - Thorough knowledge of ETL/ELT processes. - Attention to detail as the task ...

...Timings : 10:00 am - 07:00 pm IST Remote (India) • Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. -Connect with stakeholders daily to discuss project progress and updates. -Work within an Agile process to deliver projects in a timely and efficient manner. -Have worked extensively on Redshift and understands performance tuning techniques and management of Redshift data workloads. -Design and develop Airflow DAGs to schedule and manage ETL workflows. -Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. -Monitor and troubleshoot ETL pipelines to ensure smooth operation. -Custom Python functions to handle data quality and validation. ...

I need an ETL developer to streamline and automate an existing manual process. This includes: - Transferring two encrypted *. files from a source server to a local machine. - Decrypting these files into *.csv format. - Running SQL on one file and a PowerShell command on the other file to create a staging table. - Setting up a Microsoft SQL Server database into read-write mode from read-only. - Reverting the database back to read-only upon task completion. - Sending a report to the user upon task completion. Ideal skills for this job include advanced SQL, PowerShell, and ETL development. Familiarity with read/write permissions on Microsoft SQL Server and experience with data transfer and encryption/decryption processes are also highly beneficial.

I am seeking an IICS (Informatica Intelligent Cloud Services) specialist to effectively set up and integrate AWS S3/EC2 services with this platform. Key Requirements: - Set up project infrastructure per given specifications - Ensure successful integration of AWS S3 and EC2 with IICS - Establish robust connections and develop ETL processes - Configure parameter files as part of the setup While not specified, an intermediate or advanced level of IICS proficiency would be ideal for this task. Previous experience with AWS services is a must. I have not stated a timeframe for completion, indicating flexibility; however, I would appreciate if interested freelancers could provide their estimated timelines of delivery in their responses.

I am looking for an experienced Senior Data Engineer for in...looking for an experienced Senior Data Engineer for interview training. Your primary responsibility would be data cleaning and preprocessing, design and optimize database and implement ETL processes. Key responsibilities include: - Clean and preprocess data to ensure its quality and efficiency. - Design and optimize databases, aiming for both flexibility and speed. - Implement ETL (Extract, Transform, Load) processes to facilitate the effective and secure moving of data. Skills and Experience: - Proficient in Python, SQL, and Hadoop. - Expertise in handling medium-sized databases (1GB-1TB). - Proven track record in ETL processes handling. Your expertise in these areas will be crucial to the successful com...

Objective: Upgrade an existing ETL process to enhance data validation, error handling, and user feedback for structured Excel files uploaded to SharePoint 2019, for subsequent transfer to a database. The solution could be also implemented via Azure Functions and Sharepoint online if deemed possible. Existing Setup: A basic ETL process developed with the Luigi library, lacking advanced validation and user feedback mechanisms. Solution uses parsing code (Pandas) for Excel files data parsing that can be utilized for the upgrade also. There are 4 different excel files, so 4 different parsers will be provided. The system should manage four unique Excel file types, each in its own SharePoint folder, requiring separate parsers for their distinct structures. An initial selection...

Looking for an experienced MSBI and powerbi developer. You would be working with me to troubleshoot and optimize an existing MSBI solution and powerbi report. Your tasks include but are not limited to: - Data Modeling - ETL Development - Report Development For this project, your primary tools would be: - SQL Server Integration Services (SSIS) - SQL Server Analysis Services (SSAS) - power bi Your experience and skills in these areas will be critical to the success of our project. Only serious and high-quality professionals need apply. This is a challenging role and previous experience in the given areas is a must. Let's enhance our MSBI solution together and make it the best it can be.

...manage and organize data within it. - Ability to ensure data security and integrity throughout the extraction and integration process. **Ideal Skills and Experience:** - Proven track record of working with POS systems, especially Clover, for sales data extraction. - Strong background in cloud-computing platforms, specifically Azure. - Comfortable with setting up and managing data pipelines and ETL processes. - Experience in setting up automated workflows between different technological platforms. - Knowledge of data visualization and interpretation, to guide the final format of sales data within Snowflake. This project requires a freelancer who can swiftly understand our data infrastructure and implement a solution that minimizes manual intervention and maximizes data utility f...

...guidance especially in the area of ETL processes. I need to focus on: - This is an interview support role, You are supposed to help in live interviews. • Extraction techniques – The primary data sources of my interest are platforms like Spark, AWS, Azure, GCP, and Hive. I want to understand effective methods for data extraction from these particular sources. Ideal Skills and Experience: - Expertise in ETL tools for data extraction - Hands-on experience with Spark, AWS, Azure, GCP, Hive - Profound knowledge in data engineering - Experience in career coaching or mentoring will be a bonus - SQL -Python This assistance will give me a competitive edge in my upcoming interviews by providing me with practical skills, knowledge, and confidence in addressing ETL...