OutdefineJoin for free
Photo of Harpreet Singh

Harpreet Singh

ETL Developer (Extraction, Transformation, Loading)

Bareilly, Uttar Pradesh, India
1
Followers
0
Following
Careers
Data Engineer
Amazon Web Services
Full time contract5/2018 - 2/2023 
  1. - Have experience in working on building and designing complex data pipelines and Serverless applications using AWS
  2. - Highly skilled in cost optimisation w.r.t Cloud. Have reduced the cost of storing and processing the dataset by upto $1MM/year
  3. - Have a working knowledge with Spark, Python, AWS Cloud services like Kinesis, EMR, Glue , Athena , Quicksight , Lambda , DynamoDB , S3 etc
  4. - Have worked on Redshift Datawarehouse optimisation, WLM settings, performance tuning and table design
Systems Engineer
Infosys Limited
Full time contract5/2016 - 4/2018 
    Education
    Galgotias University
    B.Tech - Computer Science and Engineering
    Bachelor's DegreeClass of 2016
    Projects
    AWS Billing Pipeline Optimisation
    Lead Data Engineer
    11/2022
    N/A
    project preview
    Optimise the AWS Billing pipeline containing Line Items details(SKU details). Key Highlights:

1. Reduce the processing time by 35%
2. Save storage and compute cost by $1MM
3. Build the reusable framework based on PySpark
    Microsoft SSIS To Glue ETL Migration
    ETL Developer
    7/2022
    NA
    No image available
    Migrated to SSIS based ETL To Glue
    Skills
    PythonTransforming dataData pipelineData cleaning and preparationSparkAmazon Web ServicesData warehousingDatabase ManagementAWSArchitectures, Data lakes,Hadoop 
    Experience
    Senior-level5-8 years
    Hourly rate
    $15/hr
    Similar profiles
    1. no alt text
      Sinchana Koramageri Jayaraju 
      Data Scientist
    2. no alt text
      Dinesh  Madhivanan
      ETL Developer (Extraction, Transformation, Loading)
    3. no alt text
      Rajnesh Bhatia
      ETL Developer (Extraction, Transformation, Loading)
    4. no alt text
      Ryan Knapp
      ETL Developer (Extraction, Transformation, Loading)
    5. no alt text
      sudarshan bharadiya
      ETL Developer (Extraction, Transformation, Loading)
    astro circleWelcome to Outdefine
    A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEFN tokens. Join our vibrant community today and explore a world of possibilities for your tech career!
    Join for free