Redshiftprojekty

Need to understand the use cases for AWS storage and database design. For example, when to use EFS vs EBS vs S3? Limitations of these storages. How to select databases based on the application. When to choose SQL vs NoSQL. What are the use cases for Redshift.

Hi Luis M., I would like to offer you my project. Please let me know if this is within your capabilities: A system in which new users come to a website......updated as new info comes in. When a user returns to the landing page, we should be able to recognize if the user has already signed-up. I would like to use Segment as the foundation for this system if possible, and use it to collect and send data. Resources:

...Kaftka, Sentry) o Streaming Analytics using Spark and Kaftka o Analytics (SQL, Graph, Predictive) and Machine Learning – SQL, R, MLib, Tensor flow, Jupyter Notebook, Analytics Notebooks. o Reporting and analytical data visualisation technologies – Tableau, AWS Quicksight and SPICE engine. o Enterprise data warehouses (Exadata, RedShift) o Data Integration – Talend, AWS Glue o Amazon Web Services – Elastic Map Reduce, Kinesis (firehose, Analytics, Streams), Sagemaker, RedShift Spectrum, Quicksight & SPICE, Glue. • Working with and understanding requirements captured from data scientists and management information analyst audiences. • Delivering solutions for travel and hospitality, retail sector or similar environment. • An archite...

We are looking to add 2-3 Go engineers to join our team. More about our tech: - We are hosted in AWS (ECS/ECR/RDS/Redshift) - We use Docker and Terraform Must have some experience with: - Go/Golang (at least have written some production code) - AWS or Google Cloud This job was posted from a mobile device, so please pardon any typos or any missing details.

TOP SKILLS: Python, Redshift and Elastic search or Kibana Immediate need in Groton, CT for a Sr. Developer. This consultant should be highly skilled with Java, Python and ElasticSearch. The developer will be responsible for writing transformation scripts in Python and Java to transform scientific raw data, targeted for RedShift data warehouse. The developer will also work with Elastic, Kibana, and Java to develop custom reports. Skills we are looking for include: Python Spark RedShift ElasticSearch (preferable but not required) Java (preferable but not required)

BID if you ever worked in Airflow and PYTHON We have Airflow Set up and running dags to move data from S3 to Redshift. I am looking for help to move small table data from Amazon RDS (Oracle) to Redshift using Airflow /DAG.

Migrating Table from Oracle ODW to AWS Redshift using SCT, creating Schima and Extraction agent toload data into S3 or Redshift

I am looking for a Postgresql DBA Desired qualifications: At least 8 years experience working with Postgresql based or other similar RDBMS backends Experience designing for large backend systems (billion+ rows ) Ability to write fast queries Advanced data modeling Redis experience Fluency in Javascript (Express and Node) is a plus Fluency in python is a plus Knowledge of Amazon Redshift or big data systems is a plus This is fixed price project where you will come in and make enhancements to poorly performing system (queries are slow).

Cloud formation, kensis,lamda,ebs,s3,cloudfront,redshift,rds,vpc,route53,code depoly,code pipeline,

I need some guidance/code on AWS Redshift hierarchy levels to assist with some work I am doing probably 1 -2 hours

I need some guidance/code on AWS Redshift hierarchy levels to assist with some work I am doing probably 1 -2 hours

We have a list of 9 SQL queries to be created and then added to DOMO. Details are below, if you have any questions please duplicate the googleDoc and leave comments and send us the link. The database is hosted on RedShift. We'd like you on our company slack channel so we can communicate easily.

...system. The objective of the analysis is to build a Master Data Management schema (MDM) that accurately identify the bank’s financial entities from across the systems. Example of entities to be modeled: Customer profile, Transaction, Audit trail, financial metrics, reconciliation. Entities to be exposed as data models (data marts) that will be populated as data in a data warehouse (on Amazon RedShift) The target resource should interact, investigate, defend, and simulate the results of modeling effort he/she is doing using the existing financial schema (core banking system and others). You should answer the following questions when submitting a proposal 1. Do you have any questions about the job description? What questions do you have about the project? 2. What past...

We are a Digital Out Of Home Provider process large amounts of Data. We required an AWS specialised to assist in creating a Listener to process extremely large amount of Webhook data coming from Wi-Fi infrastructure. We need to retrieve and queue this information to be processed by Redshift. Once the information is stored we need further analysis to generate it into reports.

Hevo is a unified data platform for real-time analytics. We operate in the Data Integration and ETL space. Through this project, we aim to increase organic traffic to our blog by writing content releva...analytics. We operate in the Data Integration and ETL space. Through this project, we aim to increase organic traffic to our blog by writing content relevant to our target audience. We are looking to develop written content on the following topics: 1. Amazon Redshift 2. Google BigQuery 3. ETL 4. ELT 5. Data Integration 6. Data Pipelines Article length: 700-900 words Individuals who have prior experience in working with these technologies are preferred. SEO knowledge will be an added advantage. Skills: Redshift, Data Warehousing, Data Mining, Content Writ...

we are looking for someone to do performance tuning of our amazon redshift cluster. It takes forever for many of our queries to load so I am looking for someone to analyze the database, make recommendations for better performance and implement the recommendations. You must have extensive experience working with redshift and performance turning. I think we may have to set up star schema. Additionally, i do not want to have it re-load all of the historical data that is unchanged with each time that we run the report Please send me examples of project and let me know when you are free to chat via skype

Scope: Looking to build a slackbot that is able to naturally query AWS (redshift or s3) and return values. Operation: Develop a list of predefined commands on the front end that link to specific sql commands on the backend to return values to a user (e.g what are sales for company X during period Y)

I need something similar to

I need someone with experience in setting up Continuous deployments via CircleCI to help set up an Automatic/Continuous deployment process as such: Pull request to be checked against master Test instance of Redshift to be spun up Code to be executed on this test instance Tests set up and executed Code marked as test completed Upon merge into master the code to be automatically deployed into EC2 instance

Data Migration from Hadoop to Amazon Redshift using AWS Glue

Hi Esteban, I need similar thing to With different content that I will provide to you. Can you build these types of animations?

...dimensions and 5 Measures > Measures should be shown in Graph and number format > Ability to group and filter by dimensions and drill down on it. > the data would be in AWS redshift database (you may suggest some other DB) This job is more of a proof of concept and once we have the right freelancer we would extend this more and more analyses of this and other data. Include the word Blue Magic in your response and make the case why you are qualified for this job and I would send you a link to more info and the data file. (In order to keep it simple the data is now in CSV format, but would in production be in redshift database that would be getting new rows each day) Would need some demo of this job send to be able to read with tableau reader...

I want to design coupon and deals using WordPress. login information should be store in MySQL/Redshift/PostgreSQL database. Email subscription list also should be store in MySQL/Redshift/PostgreSQL database. Add deals/coupons using WordPress. Website should be responsive. Email unsubscribe thing also we need to do. Meaning when admin send the latest deals and offers to users. Some users will like the offers and some user will not like the offers those users want to unsubscribe the email. we need to implement this feature also. Please check attached png file. we want design like that. Note: I am looking for less rate freelancer. We want to complete this website urgent.

Need expertise using AWS S3, Redshift, SQL

I would like to build a live or close to live data pipeline from Amazon RDS (postgres) instance to Amazon Redshift and would like to get help from someone who has already DONE IT. I am not looking for help with general Amazon RDS or Redshift. I am only interested in applications that have actually done such an integration in real life.

• Architect and maintain our data Infrastructure on AWS, including: • Data Lake (Redshift) • Cluster computing resources (Apache Spark) • Distributed messaging and streaming platforms (Apache Kafka) • Distributed storage (S3) • Design and implement data applications on cluster computing and streaming engines • Design and implement data processing microservices and pipelines • Integrate with our vendors to collect and ingest second-party data into our data lake • Work with data scientists to enhance our software with the latest in machine learning algorithms and predictive models • Collaborate to ensure the integrity and cleanliness of data sources, and to support the requirements of downstream data consumers • Mentor a...

Description - Looking for experienced candidate who can migrate apllications cloud..Please mention your experience with AWS and also mention how many applications you have migrated successfully Skills- VPC,EC2,ELASTIC LB,REDSHIFT,ROUTE53,GLACIER

...Aurora MySQL instance which is appended with data from a crawler daily and a Redshift instance to which formatted data is piped through data pipeline. I have Tableau dashboards connected to RDS and Redshift in turn. What I need to achieve is the following: I wish to set up a slightly customized version of the stack above with RDS Aurora postgresql and a Redshift instance. The Redshift instance should hold the full fact tables and the RDS should hold rollup/aggregate tables of the fact tables in Redshift. The SQL worker should given certain triggers update aggregate tables and run some stores procedures. I may also need some help optimizing Redshift to reduce query execution times if that is within your skill set. Updating

...Aurora MySQL instance which is appended with data from a crawler daily and a Redshift instance to which formatted data is piped through data pipeline. I have Tableau dashboards connected to RDS and Redshift in turn. What I need to achieve is the following: I wish to set up a slightly customized version of the stack above with RDS Aurora postgresql and a Redshift instance. The Redshift instance should hold the full fact tables and the RDS should hold rollup/aggregate tables of the fact tables in Redshift. The SQL worker should given certain triggers update aggregate tables and run some stores procedures. I may also need some help optimizing Redshift to reduce query execution times. Updating of the crawler will be handled by

I should automate a process to load data from Redshift to s3.

I need a redshift developer with 3+ years of experience to help me manage Redshift cluster and write SQL queries to manipulate the data to meet the business requirements.

I need assistance setting up Phython on Windows (dev user) in order to get dbt installed and configured (dbt is from fishtown analytics - custom Jinja extensions). And this will ultimately be used as a compiler, a runner, and a package manager against Redshift (AWS). This part of the overall project will be to help me set it up on my windows machine. I imagine this happening by one on one screen share where I will work with the individual getting to get this setup and configured. Someone with good English speaking skills and knowledge of Phyton.

Looking for someone who is expert in python and familiar in using databases such us Redshift to build few python packages for a very small basic ETL solution to read data from S3 files in Amazon AWS and load to Redshift by applying some transformations on the data. time is very critical and I need this project to be delivered within 5 days. If you need more details on this project you can contact me directly for this.

Create a cloudformation template AND a terraform module that creates the following resources: · An S3 bucket with private default acl · A redshift cluster with IAM role that allows read/write access to the bucket · Input parameters: o Number of nodes o Node type/size o Name of bucket/cluster o Charge Code tag to be applied to all resources o Any other parameters you think are required · Outputs: o Redshift endpoint o S3 bucket ARN o Any other information you think would be useful to have as an output

1)Please provide one (small / medium ) use case of your Hadoop ETL work in detail. 2)f there are some X number of c...performing transformations where is the data? -------------------------------------------------- 4)Please provide one (small / medium ) use case of your work with Spark in detail -------------------------------------------------- 5)Please provide one (small / medium ) use case of your work with Redshift in detail. 6)Did you perform the ETL work? where does the data gets transformed? / While performing transformations where is the data? Or Did you simply load the data from Source to Redshift? 7)What are your Data Sources? How did you get the Data from Source to the AWS environment? 8)Did you use Python? If yes, What was the purpose you use Python for? E...

I am looking for a redshift DWH developer in or around Berlin, who can help me with the local Redshift DWH implementation. Must be able to travel to Berlin occasionally.

...[28/Aug/2017:14:38:47 +0000] "GET /0.4/query?target=%2Be9ChyFL&id=3ac218e5787584c09d96d230ed563ceb267b59f4&nonce=9d33f05fda3a5b0d09d6bf73f4078e9c44673c2d&lang=ru-RU&version=chrome-20170609&auth=c6def3a8b002ecf04e7dd629460161fc516da4f9 HTTP/1.1" 200 1148 "-" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.101 Safari/537.36" 571) - Inserting all the variables above into redshift database (for example 'insert into {table} values('{ip}','{date}','{query}','{target}','{id}')' - This process need to be automatic - once the scripts sees new archive files in the server it immediately start working on. - I need that our dev team to query o...

Only EU and Eastern Europe Applicants please! All others will not be considered no matter how great the skills are. Need a python developer with a good knowledge of SQL. Ideal candidate will have the following skills and experience. - Python usage for ETL/ELT - Python usage for API (Amazon, Shopify, Facebook, Google etc.) - Experience with either Redshift, Postgres, MongoDB - AWS experience Additionally, experience with Talend is a plus.

# Overview Alooma is a data pipeline as a service, enabling companies to rely on Alooma as a core data engineering platform to answer all of its data integration challenges. A very common use case of Alooma is to collect events generated by mobile applications, transform them into a uniform, tabular format, and load them to a cloud data warehouse like Amazon Redshift or Google BigQuery. In order to stay compatible with existing industry standards, Alooma forked existing code libraries from Mixpanel, the mobile analytics company, and made some minimal modifications to enable developers to conveniently use them in their code, sometimes alongside existing mixpanel libraries. Recently, adoption of the Alooma version of these SDKs has grown, and with it, the demand for simplicity ...

This is one of my project, and I also do many film 3D design works. I'm a senior level modelling and really good at Excellent skills with MAYA/ Zbrush/ Substacnce Painter/ RedShift/ Mari/ MarvelousDesigner/ Unfold 3D/ Quixel/ Mudbox/ Vray/ Arnold/ Photoshop

Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances o...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different ...

Looking for someone with experience installing Snowplow analytics software. You will install Snowplow Software in an AWS enviroment and you'll: 1. Setup a Snowplow Collector 2. Setup a Snowplow Tracker and/or Setup a Third-Party Webhook 3. Setup Enrich 4. Setup alternative data stores (e.g. Redshift, PostgreSQL) 5. Set up Data modeling in Redshift or database selected and set up on point 4 6. Set up environment in order we can Analyze our data! We have some things installed and set up (Vagrant, Virtual environment, Snowplow, Snowplow collector and Snowplow trackers) you can start from this point in this case you'll start in point 3 or maybe it's needed to be installed from the beginning.

Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different sy...

Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different sy...

Hello there. I am looking to create a series of 3d animations ideally using Maya. These must be high quality (almost photorealistic) for my dental surgery. The project will ONLY be awarded to a freelancer who uses Redshift.

You'll be asked to create Props to be compatible with (Autodesk Maya 2016, and Redshift 2.0.76) - Designs should be driven from Provided concept art, A spin of your own creativity is welcomed. - Models need to have Color, speculator, Normal, Displacement in 4K maps delivered with the Maya File. - if created with Z-brush, you need to provide the Z-brush files compatible with (ZBrush 4R7 P3). - Each prop have a different Maya File, Real world Scale. Props to be Created : - 2 different looking chairs - A Table ( need to have a half sphere curved into it where you roll the Dice in ) - Chess set - door - Red Dice - A key, and a key Chain. - Tillable wooden floor The general look is rough, dirty and old, so keep that in mind. Show samples, Happy bidding !

Need to develop a web application to upload text data file from desktop to amazon AWA S3. Also on the web application user can copy data from AWS S3 to AWS redshift. To finish this project, the developer should know AWS S3 and redshift very well. Also, the developer should know how to develop web application in Java or python with user login function.

*** NO AGENCIES *** I have a 30 million record mongodb database... when i make a query for example keyword search, its really slow and even timesout. I need a big data solution that can return query results in seconds. I am considering using a service like RedShift. So experience with RedShift is a plus

...all the categories and flows, solve for scale and work on internally build services to cater to our growing needs. We love to build well-abstracted modules and services – seeing ourselves as a platforms team that gives our product and engineering the wings they need to fly high. #javascript #swift-ios #java-android #reactjs #nodejs #expressjs #ejabberd-chat #mongodb #redis #postgresql #redshift #python #scala Job Requirements Hustler, with a strong can do mentality, who is joining us to build on a vision, not to do a job Minimum Bachelors in Computer Science from top-tier engineering school 3+ years experienced engineer who is comfortable building beautiful cross-platform experiences History and familiarity with server side development of APIs, databases, ...

HI. I need the following work to be done. 1. upload data from S3 to redshift 2. use AWS Lambda create REST web service for redshift table/data 3. register/ config web service in AWS api gateway what's your quote for this work?