Lead Data Platform Engineer (PySpark & Delta Lake)
Fortune #60
Experience
4 - 8 Yrs
Salary CTC
₹ 24.2 - 53.3 Lacs PA
Location
Chennai (Fully Remote)
Job Type
Full-time
6 Openings
Deadline: Nov 08, 2026
Posted 2 weeks ago
Job Overview & Description
Looking for a seasoned Data Platform Engineer to architect enterprise data lakehouses, real-time ingestion pipelines, and analytical data marts supporting our global analytics and business intelligence suites.
About Persistent Systems:
Persistent Systems is a leading global enterprise operating in IT Services & Digital Transformation. Partnered with MockAttempt Academy for specialized technical talent sourcing, campus drives, and 100% placement assurance pipelines.
Our hiring process for this role is integrated with MockAttempt Academy's verified talent benchmark.
About Persistent Systems:
Persistent Systems is a leading global enterprise operating in IT Services & Digital Transformation. Partnered with MockAttempt Academy for specialized technical talent sourcing, campus drives, and 100% placement assurance pipelines.
Our hiring process for this role is integrated with MockAttempt Academy's verified talent benchmark.
Key Responsibilities
- Build batch and real-time streaming data ingestion pipelines consuming terabytes of daily event data.
- Manage Lakehouse architectures with Delta Lake, Apache Spark, and Snowflake.
- Author DAGs in Apache Airflow with automated data quality checks and SLA monitors.
- Optimize complex SQL transformations using dbt for downstream BI consumption.
- Manage Lakehouse architectures with Delta Lake, Apache Spark, and Snowflake.
- Author DAGs in Apache Airflow with automated data quality checks and SLA monitors.
- Optimize complex SQL transformations using dbt for downstream BI consumption.
Requirements & Qualifications
- 4+ years of data engineering experience with PySpark, SQL, and cloud warehouses.
- Strong understanding of dimensional modeling, data governance, and pipeline orchestration.
- Experience with AWS S3, EMR, or Databricks platform.
- Strong understanding of dimensional modeling, data governance, and pipeline orchestration.
- Experience with AWS S3, EMR, or Databricks platform.
Required & Preferred Skills
Python
Mandatory / Must Have
Min Score: 85%
AWS
Preferred / Strongly Desired
Min Score: 85%
PySpark
Mandatory / Must Have
Min Score: 85%
SQL
Preferred / Strongly Desired
Min Score: 85%
Snowflake
Preferred / Strongly Desired
Min Score: 85%
Apache Airflow
Mandatory / Must Have
Min Score: 85%
dbt
Preferred / Strongly Desired
Min Score: 85%
Apply for this Position
Sign in or register as a candidate to submit your application and share your verified MockAttempt score.
Login to Apply Create Candidate AccountAbout Persistent Systems
Global leader in IT Services & Digital Transformation. Active hiring partner for software engineering, cloud, and data roles.
10000+ Employees