

Accomplished Data Engineer with a proven track record at Excel, leveraging skills in big data processing, ETL development, and data pipeline design to drive significant improvements in data management and analysis. Excelled in deploying machine learning algorithms for predictive analytics, demonstrating exceptional analytical and problem-solving abilities. Renowned for enhancing data governance and integration, ensuring data accuracy and integrity across all projects.
• Developed and implemented data pipelines to ingest, store and process large datasets using Apache Spark and Hive.
• Created ETL jobs to migrate data from various sources such as Oracle, MySQL, MS SQL Server into HDFS.
• Utilized Python scripts to automate the loading of data from multiple sources into a centralized system.
• Developed custom applications using Java, Python, Scala programming language for data transformation, cleansing and validation.
• Performed complex analysis on structured and unstructured datasets for insights generation.
• Designed and developed dimensional models for OLAP cube processing in Hadoop environment.
• Deployed machine learning algorithms to identify patterns in large scale datasets for predictive analytics purposes.
• Assisted database development teams with designing new programs to meet organization's data storage needs.
• Designed and developed scripts for loading and analyzing large datasets from text files.
• Developed data models for applications, metadata tables, views, and related database structures.
• Monitored databases and related systems to verify optimized performance.
• Tested programs or databases, corrected errors, and made necessary modifications.
• Utilized Microsoft Excel to generate reports and graphs based on complex datasets.
• Analyzed data trends and created visualizations for management review.
• Created SQL queries to extract data from multiple sources for reporting purposes.
• Collaborated with other departments to ensure data accuracy and integrity.
• Developed and maintained databases to store, track and analyze customer data.
• Designed and developed reports and analytics using modern data visualization tools.
• Reviewed large amounts of data across multiple platforms and sources to determine operational impacts and needed actions.