Svenska
Dansk
Dutch
Deutsch
Français
Norsk
Suomi
Sridhar V.
Data Engineer
Sridhar is a Data Engineer with over 11 years of experience, specializing in Data Integration, Big Data Engineering, Business Intelligence, and Cloud technologies.
His expertise spans data extraction, wrangling, and building machine learning models, driving effective data-driven decision-making across diverse roles, including data engineer, analyst, and business intelligence developer.
In addition to his technical expertise, he is highly skilled in creating interactive dashboards and visualizations using Power BI and Tableau, which help communicate data insights effectively. Known for his collaborative approach, Sridhar consistently delivers timely engagements, making him a reliable asset to any team.
Main expertise
- Apache Spark 5 years
- Azure Data Factory 4 years
- CSV 11 years
Other skills
- Tableau 3 years
- Git 3 years
- Azure Synapse 2 years
Selected experience
Employment
Senior Consultant
Capgemini - 6 years 7 months
- Successfully led the migration of ETL pipelines from SSIS to Azure Data Factory (ADF), ensuring a smooth transition and improved data integration processes;
- Utilized Databricks notebooks with PySpark and SparkSQL to analyze data effectively, enabling insightful data-driven decision-making;
- Developed Azure Databricks notebooks to retrieve data from various social APIs, including FB, Twitter, YouTube, and Google Analytics;
- Automated the ETL process for loading historical data from FB and Instagram APIs, resulting in significant time savings of 500 hours by eliminating manual effort;
- Built ADF pipelines to execute Databricks pipelines on a scheduled basis, ensuring timely and accurate data processing;
- Created dataflows using ADF V2 pipelines, facilitating seamless data transformation and integration;
- Identified and resolved issues reported by downstream applications, ensuring data integrity and smooth data flow;
- Automated the data load process, reducing manual intervention and improving efficiency;
- Enhanced data load performance from APIs, implementing strategies to optimize data retrieval and processing for downstream applications;
- Leveraged Delta tables in Databricks for performing upsert operations, ensuring data consistency and integrity.
Technologies:
- Technologies:
Azure Data Factory
Azure Synapse
Lead IT
Deloitte India (Offices of the US) - 3 months
- Demonstrated solid analytical skills by understanding requirement specification documents and developing SQL queries accordingly;
- Developed efficient and optimized stored procedures based on the requirements, ensuring adequate data processing and retrieval;
- Conducted proof of concept (POC) to assess the feasibility and benefits of migrating the existing solution to Azure, providing valuable insights for decision-making;
- Identified and implemented performance improvements in existing stored procedures and SQL functions, enhancing query execution speed and overall system efficiency;
- Designed and created a reusable SSIS (SQL Server Integration Services) package to load data iteratively, streamlining the data loading process and improving data integration capabilities.
Senior Software Engineer
Hilti Asia IT Services - 1 year
- Built an Azure-based data warehouse and database platform to enable fast analysis and decision-making.
- Managed ELT processes, extracting data from SAP HANA, SAP BW, and SAP ERP for database integration.
- Utilized Power BI for data visualization, delivering valuable insights from extracted datasets.
- Designed and optimized data models and structures for efficient storage and retrieval.
- Ensured data quality through cleansing, transformation, and enrichment processes.
- Monitored and troubleshot database performance, resolving issues proactively.
- Collaborated with stakeholders to gather and address reporting and analytical requirements.
- Kept up with industry trends and integrated new technologies to enhance data analysis capabilities.
Technologies:
- Technologies:
-
Azure Data Factory
-
Azure Synapse
IT Analyst
Tata Consultancy Services - 5 years 6 months
- Developed ETL packages in SSIS for efficient data extraction, transformation, and loading;
- Gathered requirements from stakeholders to ensure a clear understanding of business needs;
- Designed and built Tabular and Multi-Dimensional SSAS cubes for comprehensive data analysis;
- Created visually appealing Power BI reports and dashboards to provide valuable insights;
- Conducted data profiling and cleansing to maintain data quality and integrity;
- Optimized performance of ETL packages, SSAS cubes, and Power BI reports;
- Stayed updated with the latest ETL, SSAS, and Power BI technologies;
- Provided guidance and support to junior team members;
- Collaborated with stakeholders to understand evolving business needs and make necessary adjustments to ETL processes, SSAS cubes, and Power BI reports.
Education
Standalone courseData Analyst
Udacity · 2017 - 2018
BSc.Electronics and communication Engineering
Gandhi Institute of Engineering and Technology · 2007 - 2011
Find your next developer within days, not months
In a short 25-minute call, we would like to:
- Understand your development needs
- Explain our process to match you with qualified, vetted developers from our network
- You are presented the right candidates 2 days in average after we talk