Senior Databricks Engineer

We are seeking a highly skilled and proactive Senior Databricks Engineer with 7-8 years of experience in data engineering, cloud-based data platforms, and large-scale data processing. The ideal candidate will have deep expertise in Azure Databricks, Apache Spark, data warehousing, and modern data architecture. This role requires a sharp technical professional who can independently design, build, optimize, and maintain scalable data solutions while collaborating closely with business and technical stakeholders. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark. Build and optimize ETL/ELT processes for large-scale data integration and transformation. Develop and manage Delta Lake architectures to ensure data reliability, governance, and performance. Implement and maintain data ingestion frameworks from various structured and unstructured data sources. Collaborate with data architects, analysts, and business teams to translate requirements into technical solutions. Monitor, troubleshoot, and optimize Databricks workloads for performance and cost efficiency. Ensure adherence to data governance, security, and compliance standards. Automate deployment processes using CI/CD best practices. Mentor junior engineers and contribute to technical design discussions and architecture reviews. Participate in code reviews and drive engineering best practices across the team. Requirements Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field. 7-8 years of overall experience in Data Engineering. Minimum 4+ years of hands-on experience with Azure Databricks. Strong expertise in Apache Spark (PySpark and/or Scala). Advanced SQL development and performance tuning skills. Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. Strong understanding of Delta Lake architecture and Lakehouse concepts. Experience building robust ETL/ELT pipelines in enterprise environments. Knowledge of data modeling, warehousing, and dimensional modeling concepts. Experience with Git, DevOps practices, and CI/CD pipelines. Strong troubleshooting, analytical, and problem-solving skills. Benefits PF: 8% OPD IPD Fuel Allowance