Sai Pavan Kunda
I am Sai Pavan Kunda a recent Master graduate and experienced Data Engineer and expertise in ETL pipelines, Data migration,Building Dashboards and more work related to data.Please have a look at portfolio. https://saipavankunda.netlify.app/
- • Tools and Technologies: Azure Data Factory, Azure Data lake, Databricks, Bigquery, Python, Visual Studio
- • Migrated database objects from Microsoft Synapse to Bigquery, including Stored Procedures and Views using Azure Data Factory.
- • Developed Pyspark notebooks in Databricks to ingest data from various sources and created driver notebooks to fetch GBQ environment config files when running ADF pipelines.
- • Analyzed triggers to fetch GBQ environment config and source files while running ADF pipelines, and applied transformation rules to source/target application data.
- • Built pipelines using Azure Data Factory and created transformation logic to meet business requirements.
- • Conducted end-to-end testing of applications to ensure functionality aligns with business requirements.
- • Tools and Technologies: Spark , HDFS, ETL pipeline, HIVE
- • Configured Hive database to store and manage data, optimizing
- database performance and scalability, and ensuring data consistency
- and accuracy.
- • Setup a ETL pipeline using spark to extract data from multiple
- sources and load it into hive database.
- • Developed transformation code to manipulate the data stored in
- the Hive database according to specific requirements, incorporating
- data quality and validation checks to ensure the accuracy
- and completeness of the processed data.
- • Tools and Technologies: HDFS, Hive
- • Designed and developed data pipelines using Hadoop ecosystem
- technologies to process and analyze large volumes of data from
- multiple sources, including transactional systems, log files, and
- customer feedback.
- • Developed and optimized Hive queries to transform and aggregate
- data, enabling faster and more efficient analysis of business
- performance and customer behavior
Illinois institute of technology
Do a 3+ years exp and 2+ years of master stud gets a full time..........?
Welcome to Outdefine
A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEFN tokens. Join our vibrant community today and explore a world of possibilities for your tech career!Join for free