Apache Spark Yarn Out of Memory Error Resolution - open to bidding

Hi, I'm an experienced java, J2EE application developer. I have 10 years experience building Java, J2EE applications. Please check comments from other project owners on my service. I'm very happy to work for you. Contact me if you are interested. Thanks, Rick

A proposal has not yet been provided

Hi, • I have 9 years of experience in JAVA and open source Java based web technologies with network and security domain. • My Carrier is start with java web based development to till today. • Throughout my carrier I have involve complete product development cycle. Understand requirement, prepare the document for module or project, developing the project, deployment on clustering environment, testing and maintenance. • Good knowledge of E-Commerce ,ERP , shipping, Media and Entertainment domains. • Strong knowledge of OOPS design principal and pattern. • Also have experience in agile methodology. My Skill set Matrix: Java EE (JSP, JSF, Servlet, JMS, JDBC, JPA etc): More than 7 years Design Pattern:5 Years UML/Design: 7 years HTML/CSS/Javascript, CSS, JQuery, ExtJS: 7 years HTML5 Frameworks (Foundation/Bootstrap): 1 years Struts: 7 years Spring3 (MVC, IoC, Security, Transactions, ORM): 6 years Hibernate: 6 years XML/Web services (SOAP/REST): 4 years JUnit/Mockito: 2 years MySQL, DB2, SQL Server, Oracle: 7+ years Mongo DB: 1 year AngularJS: 1.5 Year NodeJS:6 month Ant, Maven: 7 years Git, SVN, CVS: 7 years Build Tool(Jenkins/Sonar):2 Years IDE (Eclipse):7 years Amazon AWS, EC2, S3, SNS,EMR,: 3 years Tomcat, JBoss, Websphere: 7+ years Windows, Linux/Unix: 8 years Let me know if you need more detail. Looking forward to working with you.

I will like to talk you in deep for this so i can fulfill your expectation to resolve this problem thanks.

A proposal has not yet been provided

I have 4+ years of experience working for data driven companies in Hadoop ecosystem as architect, admin, developer and analyst in devops based teams doing hadoop cluster installations, upgrades ,realtime and batch data analytics. Extensive knowledge of Tableau Desktop (latest 9.0), Tableau Server and Amazon AWS services too.

We have a team of experts on the subject matter. Can provide more details after we look at the cod and the versions of Spark and Hadoop. Meanwhile you can look if any of the below is happening in your code. 1)Problem can occur if you have collect() operations on a large data set or operations which requires all the data to be shipped to driver . in your code. 3) you are trying to cache all data in to memory. try setting persistence level to disk. 2) Not sufficient memory reserved for your executors.