My Portfolio
Data Engineer with 5+ years of experience specializing in cloud-based data solutions, real-time pipelines, and AI-driven architectures. Proven expertise in Azure, Databricks, AWS, and Microsoft Fabric with multiple current certifications.
Email: parthnvalani@gmail.com
Phone: (807) 357-6372
Location: Toronto, ON
Portfolio
LinkedIn
π¨βπΌ Work Experience
Avanade
Data Engineer
Jan 2025 β Present | Toronto, ON
- Architected and implemented a unified AI-driven data model in Microsoft Fabric, integrating multiple source systems, reducing report preparation time by 60%.
- Led an offshore engineering team to refactor and optimize Databricks pipelines, applying advanced Spark performance tuning to improve stability and cut processing time by 50%.
- Collaborated on the design and launch of real-time data streaming pipelines with Kafka and Airflow, achieving a 40% reduction in data latency.
Deloitte
Data Engineer
Jan 2022 β Dec 2024 | Toronto, ON
- Designed and implemented an end-to-end Azure Databricks solution with PySpark and SQL for a major telecom company, boosting cross-selling revenue by $2M.
- Developed an AWS-based ETL pipeline enabling cleanroom data quality, profiling, and modelingβdriving a 30% growth in client sales.
- Built data validation checks for vendor data in Dynamics 365CE using Azure Synapse pipelines, ensuring robust logging and integration.
- Generated Power BI visualizations revealing customer overlap and proximity, leading to a 25% improvement in marketing decisions.
Tata Consultancy Services
Software Developer
Oct 2021 β Dec 2021 | Toronto, ON
- Diagnosed scheduling conflicts in Control-M workflows, reducing manual intervention by 5+ hours weekly.
- Optimized PostgreSQL queries for flight sales data, identifying trends that increased monthly sales by $10K.
π Skills & Interests
- Cloud & Data Engineering: Microsoft Fabric, Azure (Data Lake, Synapse, ADF, Data Share, DevOps, PowerApps, Dynamics 365), AWS (S3, Athena, Redshift, Glue), Databricks (Delta Lake, Unity Catalog), Snowflake, Apache Kafka, Apache Airflow, Control-M
- Programming & Databases: Python, SQL, PySpark, PostgreSQL, SSMS, Git, Docker
- Data Analytics & ML: Power BI, TensorFlow, Pandas, NumPy, Scikit-learn
- Interests: Reading non-fiction, traveling, badminton, EDM & film scores
π Certifications
- Databricks Certified Data Engineer Associate (2024 β 2026)
- Microsoft Certified Fabric Data Engineer Associate (2025 β 2026)
- AWS Certified Machine Learning β Specialty (2022 β 2025)
- Microsoft Certified: Azure AI Fundamentals (2024 β 2025)
- Databricks Certified Associate Developer for Apache Spark 3.0 (2023 β 2025)
π Education
Lakehead University
MSc, Computer Science
Sep 2019 β May 2021 | Thunder Bay, ON
L.D. College of Engineering
BE, Information Technology
Jun 2015 β Jun 2019 | Ahmedabad, IN