Databricks Specialist
- কোম্পানি
- brac IT
- এলাকা
- Dhaka
- চাকরির ধরন
- Full Time
- বেতন
- আলোচনাসাপেক্ষ
- অভিজ্ঞতা
- 5+ years
- শিক্ষাগত যোগ্যতা
- Bachelor
- আবেদনের শেষ তারিখ
- 2026-11-30
চাকরির বিবরণ
brac IT is looking for an experienced Databricks Specialist for its Managed Service team in Dhaka. The role covers the full path from raw data to trusted, reusable Delta tables: developing Databricks jobs, choosing the right load method, managing downstream impact on dependent use cases, and resolving failures in a live production environment. The specialist works closely with business data product owners, use case teams and platform engineers under ticket-based change control and disciplined documentation. Selection is by a technical or functional interview, an HR interview and an offer.
দায়িত্ব
- Design, build and maintain Databricks jobs (PySpark and SQL) that turn raw landed data into curated, trusted Delta tables
- Select and implement the right load method for each data product: full refresh, SCD Type 1 or SCD Type 2
- Build new data products end to end when new sources are approved, from ingestion hand-off to scheduling, alerting and documentation
- Extend existing data products with new columns, tables or source data, and remove data that is no longer required
- Monitor scheduled jobs, investigate failures and trace issues back through the data layers to their root cause
- Reprocess historical data from the raw layer when a fix must apply to past loads
- Work with Azure Data Factory pipelines and Azure Data Lake Storage Gen2 to keep ingestion and processing aligned
- Maintain the dependency map between data products and the use cases that consume them, and check every change against it before release
- Tune job schedules, run times, cluster configuration and compute cost, and recommend optimization opportunities
- Work through ticket-based change control on Azure DevOps and document every data product, change and fix
যোগ্যতা
- 5+ years of data engineering experience, including hands-on production work in Azure
- Strong Apache Spark (PySpark) and SQL skills, with experience building and optimizing Delta Lake tables
- Practical experience with load patterns including full refresh, SCD Type 1 and SCD Type 2
- Working knowledge of Azure Data Factory, Azure Data Lake Storage Gen2 and the Azure data platform
- Experience with Databricks workflows, clusters, repositories and job scheduling, including performance and cost tuning
- Familiarity with Git-based source control and CI/CD (Azure DevOps or GitHub)
- Strong debugging skills across multi-layer data platforms (raw, curated and consumption layers)
- Clear communicator able to work with remote, international stakeholders
- Preferred: experience operating an enterprise Data Lake in the automotive, manufacturing or logistics sector, Python-based data quality checks or Airflow, Power BI exposure, and Microsoft or Databricks certifications
দক্ষতা
- Azure Data Factory
- Azure DevOps
- Databricks
- Delta Lake
- PySpark
- SQL