About the Role:
Techwards is looking for a skilled Data Architect to design and implement data solutions for our retail D2C clients. You will build scalable, high-performance data architectures using Databricks and related technologies, driving significant business value.
Experience: 5 to 7 years
Education: Bachelor’s or Master’s degree in Computer Science or a related field.
Key Responsibilities:
- Data Architecture & Strategy: Design scalable data lakehouse architectures on Databricks, define data strategies, ensure data quality and security.
- Data Pipeline Development: Design and manage ETL/ELT pipelines for performance and reliability.
- Data Modeling & Lakehouse Management: Implement dimensional models, manage data lakes/lakehouses on Databricks, ensure data cataloging.
- Cloud Integration: Integrate Databricks with other cloud platforms and applications.
- Collaboration: Work with stakeholders to understand requirements and deliver data solutions.
- Continuous Improvement: Stay updated on data technologies and optimize data architectures.
Key Technical Skills (Required):
- Expertise in Apache Spark & Databricks: Extensive hands-on experience for data processing, deep understanding of the Databricks platform.
- Proficiency in SQL: Advanced SQL for transformations and analytics.
- Distributed Data Processing: Create and manage distributed Spark jobs.
- OLAP Databases: Ability to work with OLAP databases like ClickHouse, DuckDB, Redshift.
- Stream Data Pipelines: Design and implement stream data pipelines.
- Python Programming: Proficient with Python and data libraries (PySpark, Pandas, NumPy).
- Data Lake File Formats: Handle various file formats (CSV, Parquet, JSON, Avro).
- Metastore Expertise: Proven experience in working with metastores (Unity Catalog, Hive Metastore, Glue Data Catalog).
Good to Have Skills (Desirable):
- Lakehouse Architectures: Experience with Iceberg, Delta Lake, or Hudi.
- MLOps & MLFlow: Familiarity with MLOps and MLFlow for data science support.
- Data Visualization: Experience with Power BI, Tableau, Databricks BI.
- Retail Industry Experience: Past retail industry data experience.
- Cloud Certifications: Relevant cloud certifications.
- Data Governance & Security: Understanding of data governance and security.
- Project Management: Experience managing data projects.
- Workflow Orchestration: Knowledge of Airflow, Dagster, or dltHub.
What we are offering?
- A purpose driven environment aiming for holistic human development
- Market competitive compensation package
- Healthcare coverage (self, spouse, children, and parents)
- OPD coverage (self, spouse, children, and parents)
- Annual Medical Checkup
- Quarterly learning based incentive (as per requirements)
- Technical / non-technical training sessions
- On-site fitness & self-development activities
- Opportunity for in-house Qur’anic recitation with tajweed
- Weekly spirituality sessions
About Techwards
Techwards is a leading software development company specializing in AI transformation services, application modernization, MVP development, and tailored software solutions. Our team of experts combines cutting-edge technology with innovative strategies to help businesses thrive in the digital age. We pride ourselves on delivering top-notch solutions that exceed our clients’ expectations and drive measurable results.