CyberCoders Data Engineer Spark - in San Francisco, California

Data Engineer Spark - Data Engineer Spark - - Skills Required - Hadoop, SPARK, Linux, Engineer

If you are a Data Engineer Spark with experience, please read on!

Top Reasons to Work with Us

Highly reputable

What You Will Be Doing

Develop custom ETL applications using Spark in Python/Java that follow a standard architecture.

Success will be defined by the ability to meet requirements/acceptance criteria, delivery on-time, number of defects, and clear documentation.

Perform functional testing, end-to-end testing, performance testing, and UAT of these applications and code written by other members of the team.

Proper documentation of the test cases used during QA will be important for success.

Other important responsibilities include clear communication with team members as well as timely and thorough code reviews.

As you grow in the role, you will have the opportunity to contribute to designing of new applications, setting/changing standards and architecture, and deciding on usage of new technologies.

What You Need for this Position

Linux - common working knowledge, including navigating through the file system and simple bash scripting

Hadoop - common working knowledge, including basic idea behind HDFS and map reduce, and hadoop fs commands.

Spark - how to work with RDDs and Data Frames (with emphasis on data frames) to query and perform data manipulation.

Python/Java - Python would be ideal but a solid knowledge of Java is also acceptable.


Source Control Management Tool - We use BitBucket


Worked/developed in a Linux or Unix environment.

Worked in AWS (particularly EMR).

Has real hands-on experience developing applications or scripts for a Hadoop environment (Cloudera, Hortonworks, MapR, Apache Hadoop). By that, we mean someone who has written significant code for at least one of these Hadoop distributions.

Has experience with ANSI SQL relational database (Oracle, SQL, Postgres, MySQL)

What's In It for You

Great Salary and Benefits

So, if you are a Data Engineer Spark with experience, please apply today!

Applicants must be authorized to work in the U.S.

CyberCoders, Inc is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, or any other characteristic protected by law.

Your Right to Work – In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.

Data Engineer Spark - CA-San Francisco RC4-1466982