Role Overview: As a Senior Azure Data Engineer at BizMatric, you will play a pivotal role in designing, implementing, and optimizing data solutions on the Azure cloud platform. You will be responsible for architecting scalable data pipelines, integrating various data sources, and ensuring the reliability and performance of our data infrastructure. The ideal candidate will have a strong background in Big Data technologies, Azure/AWS Cloud, DataBricks, Spark/Pyspark, and SQL, with a proven track record of delivering complex data projects. Key Responsibilities: Design, develop, and deploy scalable data pipelines on the Azure cloud platform. Architect end-to-end data solutions to support business requirements and analytical insights. Implement and optimize data processing workflows using technologies such as DataBricks, Spark, and Pyspark. Integrate diverse data sources including structured and unstructured data for analysis and reporting purposes. Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. Ensure data quality, reliability, and security across all data processes and systems. Provide technical guidance and mentorship to junior team members. Stay abreast of emerging technologies and best practices in the field of Big Data and cloud computing.
