S

Staff Engineer - Databricks

Smartsheet
Bangalore, INDIA 1 day ago
AI overview

This role focuses on designing, developing, and optimizing scalable data platforms and pipelines. The Staff Engineer will manage data architecture, modeling, and governance, while ensuring data security and compliance. This position requires over 10 years of experience in data engineering, with a strong background in system design for large datasets and modern AI/data infrastructure.

You Will:

  • Data Architecture and Design: Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems
  • Data Modelling and Management:Developing and implementing data models, ensuring data quality, and establishing data governance policies
  • Data Pipeline Development: Building and optimising data pipelines for ingesting, processing, and transforming large datasets from various sources
  • Performance Optimisation: Identifying and resolving performance bottlenecks in data pipelines and systems, ensuring efficient data retrieval and processing
  • Technology Evaluation and Innovation: Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure
  • Troubleshooting and Problem Solving: Diagnosing and resolving complex data-related issues, ensuring the stability and reliability of the data platform
  • Data Security and Compliance: Implementing data security measures, ensuring compliance with data governance policies, and protecting sensitive data
  • Perform other duties as assigned

You Have:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 10+ years of experience in data engineering or a similar role.
  • Enterprise SaaS software solutions with high availability and scalability
  • Solution handling large scale structured and unstructured data from varied data sources
  • Experience in building and maintaining data platform systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure ensuring scalability, reliability, efficiency and security
  • Working with Product engineering team to influence designs with data, AI and analytics use cases in mind
  • In depth experience in System design involving large Petabytes of data with Databricks Lakehouse
  • Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context)
  • AWS, GCP, Snowflake and Data pipeline frameworks like Airbyte/Airflow
  • Programming languages like Python, SQL, and potentially Java or Scala
  • Modern software engineering practices like Kubernetes, CI/CD, IAC tools (Preferably Terraform), Observability, monitoring and alerting
  • Solution Cost Optimisations and design to cost
  • Driving engineering excellence initiative
  • Legally eligible to work in India on an ongoing basis
  • Fluency in English is required

Equal Opportunity Employer:

Smartsheet is an Equal Opportunity (EEO) employer committed to fostering an inclusive environment with the best employees. It is our policy to provide equal employment opportunities to all qualified applicants in accordance with applicable laws in the US, UK, Australia, Germany, Costa Rica, Japan, Bulgaria, India, and Singapore. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.

If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

#LI-Remote

Key details

Posted1 day ago

Frequently asked questions