OutdefineJoin for free


As a skilled professional seeking career growth, you deserve access to the best job opportunities available. Join Outdefine's Trusted community today and apply to premier job openings with leading enterprises globally. Set your own rate, keep all your pay, and enjoy the benefits of a fee-free experience.

career-heroJoin now
Back to jobs
Outdefine partnerVerified partner
Data EngineerOutdefine Partner
San Francisco, CA, USA
Apply Now

About the job


Job Overview

Location: Onsite, Plano – TX, US 8-10 years’ experience as Data Engineer Only locals – no relocation Long term contract – 1099 or C2C Visa: USC, GC, H4EAD

Required Skills: Spark, Scala, Databricks and AWS

Technology: Analytics

• Seeking a highly skilled Data Engineer with 8-10 years of experience in. Must have expertise in Spark and Scala. • 5+ Years of IT experience in AWS Cloud, Databricks, AWS S3 , Spark/Scala ,Big Data tool and technologies • Build Data Mapping documents before coding with provided requirements • Excellent knowledge in writing SQL queries for any given problem statement • Programming knowledge in AWS Cloud, AWS Glue ETL, Scala, Java or Python (preferable Scala) • Good understanding of Spark concepts – RDD/Dataframes/Datasets/Streaming and experience with coding in Scala is preferred • Need to have a good understanding of cloud terminologies in AWS and have a good grasp of all basic AWS services (eg. S3/IAM etc.)


• Perform Data Analysis understanding the existing business requirements • Design and build scalable data pipelines using Big Data stack Databricks, Spark Scala, AWS – Athena, S3, Glue ETL, Redshift, Dynamo DB • Design Ingress and Egress patterns for data lake to support self-service use cases and improve time to business value. • Implement CI/CD data pipelines using Git Hub, Jenkins and Artifactory to automate the code build and promotion process. • Engage with customers and principal architects, understand the business requirements and build AWS cloud big data platform and solutions. • Create proof of concepts, evaluate new products and develop a roadmap for NextGen Technology and Digital Cloud First strategy • Jobs Orchestration • Ability to work independently and guide other new team members end-to-end from Development to unit testing to UAT and Prod Deployment/cut over ensuring quality • Any experience with AWS Cloud, AWS Glue ETL, Databricks Delta/Redshift/ Talend Big Data would be added advantage • Good written and oral communication skills • Ability to work independently in agile scrum methodology

Skills required
Database systemsScalaAWSSparkGithub
Employee location
San Francisco, CA, USA
Experience level
Not specified
Workplace type
Job type
full time contract
$48 - 52 /hr

Become a trusted member, apply to jobs, and earn token rewards

backgroundtopCreate a profile

Create and customize your member profile.

backgroundtopComplete assessment

Earn 500 Outdefine tokens for becoming trusted member and completing your assessment.

backgroundtopApply for jobs

Once you are a Trusted Member you can start applying to jobs.

Apply Now