Skip to main content

Senior Databricks Engineer at Tredence

Short Description:

Tredence, a leading analytics and data science company, is hiring a Senior Data Engineer with 3-6 years of experience for roles in Bangalore, Chennai, Delhi, Pune, and Kolkata. The candidate will be responsible for developing advanced Data Warehouse solutions using Databricks and AWS/Azure Stack, collaborating with DW/BI leads, and addressing ETL pipeline development requirements. Strong skills in SQL, Python, and Spark (PySpark) are essential, along with experience in AWS/Azure stack. The ideal candidate should have expertise in data modeling, Databricks Data & AI platform, and proficiency in managing structured and unstructured data.



 

Job Title: Senior Databricks Engineer

Organization: Tredence

Position: Senior Data Engineering Professional (3-6 years experience)

Work Locations: Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence:

Tredence is dedicated to delivering impactful insights that drive profitable actions by integrating business analytics, data science, and software engineering. We collaborate with major companies across various sectors, deploying predictive and optimization solutions at scale. Headquartered in the San Francisco Bay Area, our clientele spans the US, Canada, Europe, and South East Asia. We are in search of an accomplished data scientist who not only possesses the required mathematical and statistical expertise but also exhibits natural curiosity and a creative mindset to explore, connect, and unveil hidden opportunities, ultimately unlocking the full potential of data.

Primary Roles and Responsibilities:

  • Develop advanced Data Warehouse solutions utilizing Databricks and AWS/Azure Stack.
  • Offer forward-thinking solutions in the realm of data engineering and analytics.
  • Collaborate with DW/BI leads to comprehend new ETL pipeline development requirements.
  • Identify gaps in existing pipelines and rectify issues efficiently.
  • Work closely with the business to understand reporting layer needs and develop data models accordingly.
  • Assist team members in resolving issues and technical challenges.
  • Lead technical discussions with client architects and team members.
  • Orchestrate data pipelines in scheduler via Airflow.

Skills and Qualifications:

  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Minimum of 3 years of IT experience and 3+ years' hands-on experience in Data warehouse/ETL projects.
  • Profound understanding of Star and Snowflake dimensional modeling.
  • Robust knowledge of Data Management principles.
  • Thorough understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
  • Hands-on experience in SQL, Python, and Spark (PySpark).
  • Experience in AWS/Azure stack is mandatory.
  • Desirable skills include ETL with batch and streaming (Kinesis).
  • Proficiency in building ETL/data warehouse transformation processes.
  • Familiarity with Apache Kafka for streaming data/event-based data.
  • Exposure to Open-Source big data products, including Hadoop (incl. Hive, Pig, Impala).
  • Familiarity with Open Source non-relational/NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
  • Experience with structured and unstructured data, including imaging & geospatial data.
  • Proficient in working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
  • Experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/PySpark/Spark with Azure/AWS Databricks

Please click here to apply.

Comments

Other popular job openings

Capgemini is hiring for a fresher entry level Data Analyst role in India

  (OPENING IS CLOSED NOW)   Position: Data Analyst Company: Capgemini Cloud Location: Hyderabad, Telangana, India Job Type: Permanent Job Mode: On-site Job Requisition ID: 57228-en_US (OPENING IS CLOSED NOW) Years of Experience: 0-3 years Company Description Capgemini Cloud is a leading global technology firm that specializes in digital transformation, consulting, and engineering services. The company provides cloud-first solutions that enable businesses to achieve agility, innovation, and growth through advanced IT strategies. With over 10,001 employees, Capgemini Cloud is a powerhouse in information technology and services, helping enterprises adopt hybrid cloud journeys and optimize cloud economics. The organization focuses on digital innovation, leveraging AI-driven insights to drive competitive advantage in various industries. As a pioneer in cloud transformation, Capgemini Cloud ensures clients achieve business efficiency and operational excellence through tailored tec...

Concentrix is hiring for a fresher entry level Data Analyst role in India

Position: Analyst, Forecasting Company: Concentrix Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: On-site Job Requisition ID: R1528878 Years of Experience: Even relevant internship experience works Company Description Concentrix is a globally recognized leader in technology-enabled business services, specializing in customer engagement and enhancing business performance. The company partners with forward-thinking executives worldwide to provide innovative solutions that future-proof businesses against evolving market challenges and customer demands. With a strong emphasis on digital transformation, Concentrix delivers comprehensive end-to-end solutions that integrate advanced technologies, strategic insights, and industry expertise. The organization supports over 2,000 clients across various industries, helping them streamline operations, improve customer experience, and optimize business outcomes. Concentrix operates at scale, leveraging cutting-edge AI-powered an...

Genpact is hiring for a fresher entry level Management Trainee - Data Scientist Consultant role in India

Position: Management Trainee - Data Scientist Consultant Company: Genpact (NYSE: G) Location: Gurugram, India Job Type: Full-time Job Mode: Onsite Job Requisition ID: BFS042283 Years of Experience: Entry-level (Relevant internship or project experience preferred) Company Description Genpact is a globally recognized professional services and solutions firm that drives transformative business outcomes. With a workforce of over 125,000 employees across more than 30 countries, Genpact fosters a culture of curiosity, innovation, and agility. The company specializes in offering digital operations services, leveraging deep industry knowledge, AI-driven solutions, and technological expertise. Genpact partners with leading enterprises, including Fortune Global 500 companies, to drive efficiency, productivity, and innovation. The core mission of Genpact is to continuously improve the way businesses function, enhancing customer experiences and operational effectiveness. Through AI, automation, da...

IBM is hiring for a fresher entry level Data Engineer role in India

Position: Data Engineer - Data Integration Company: IBM India Private Limited Location: Pune, Maharashtra, India Job Type: Fixed Term (Fixed Term) Job Mode: Hybrid Job Requisition ID: 14894 Years of Experience: Entry-Level Position Company Description: IBM is a globally recognized leader in technology and consulting services, with a legacy spanning over a century. The company specializes in AI, hybrid cloud computing, and enterprise solutions that drive digital transformation. IBM Consulting, a subsidiary of IBM, delivers cutting-edge business and technology solutions across diverse industries. IBM prides itself on innovation, collaboration, and sustainable business practices, focusing on creating meaningful impact through technology. The organization fosters a growth-oriented work environment, encouraging employees to learn, experiment, and contribute to transformative projects. IBM Consulting’s Client Innovation Centers serve as a hub of technical expertise, supporting clients in bot...

Capgemini is hiring for a fresher entry level Machine Learning Engineer role in India

Position: Machine Learning Engineer - A Company: Capgemini Automotive Location: Hyderabad, India Job Type: Permanent Job Mode: Full-time, On-site Job Requisition ID: Ref. code 59661-en_US Years of Experience: 0-3 years Company Description: Capgemini Automotive is a leading global organization specializing in innovative solutions within the automotive industry. With a workforce exceeding 10,001 employees , the company has built a reputation for delivering cutting-edge technologies and services to drive the digital transformation of automotive businesses. The company plays a key role in revolutionizing the industry by leveraging emerging technologies, data-driven insights, and strategic collaborations. Capgemini Automotive focuses on key areas such as intelligent mobility, connected vehicles, electrification, and software-defined automotive solutions . With a mission to reshape the automotive landscape, the company partners with OEMs, suppliers, and technology firms to develop smart, sc...

Optum is hiring for a fresher entry level HR Data Analyst role in India

Position: People Analytics (HR Data Analyst) Company: Optum Location: Gurgaon, Haryana, India Job Type: Full-time Job Mode: On-site Job Requisition ID: 2269837 Years of Experience: 0-3 years Company Description: Optum is a globally recognized healthcare and technology-driven organization committed to enhancing health outcomes. Through its integrated services, Optum aims to empower individuals by providing access to essential care, pharmacy benefits, and data-driven resources that improve well-being. The company fosters a workplace culture that values diversity, equity, and inclusion, ensuring that every employee thrives in a supportive environment. Comprehensive benefits and career growth opportunities are integral to Optum’s employment philosophy. As a subsidiary of UnitedHealth Group, Optum leverages cutting-edge technology and data analytics to drive improvements in healthcare. The company is dedicated to delivering equitable healthcare solutions, addressing systemic disparities, an...

FirstHive is hiring for a Data Analytics Intern role in India

Position: Data Analytics Intern Company: FirstHive Location: Bangalore, India Job Type: Internship Job Mode: In-office (Full-time) Job Requisition ID: Not specified Years of Experience: Not required (Open to students and recent graduates) Company Description: FirstHive is a cutting-edge customer data platform designed to consolidate and analyze customer interactions from multiple sources, such as ERP, CRM, websites, social media, point-of-sale systems, mobile applications, and customer support. The platform leverages artificial intelligence to build unique customer identities and enhance marketing efforts. FirstHive enables seamless customer engagement by facilitating campaigns through various channels, including email, SMS, voice, web browsers, mobile apps, and social media platforms like Facebook, LinkedIn, Twitter, and Instagram. With advanced behavioral analytics, FirstHive allows marketers to trigger actions based on user behavior on one channel and execute engagements on another....

ISA is hiring for a fresher entry level Data Analytics Engineer role in India

Position: Data Analytics Engineer Company: Information Systems Associates - Sharjah (ISA-SHJ) Location: Bengaluru East, Karnataka, India Job Type: Full-time Job Mode: On-site Job Requisition ID: Not specified Years of Experience: Not specified; as per JD looks like a fresher entry level role; 0-3 years Company Description: Overview: Information Systems Associates (ISA) is a technology solutions provider specializing in the global travel and airline industry. Established in 2005, ISA has built a strong reputation for delivering high-performance IT solutions. Industry & Services: The company operates within the IT services and consulting domain, catering to airlines, travel agencies, and other related businesses. It offers a diverse portfolio of solutions that address multiple aspects of airline and travel management. Workforce & Presence: ISA employs between 201-500 professionals, demonstrating its mid-sized operational scale. The organization maintains an active presence on Lin...

Analog Devices is hiring for a Data Analyst/Data Scientist - Intern role in India

Position: Data Analyst/Data Scientist - Intern Company: Analog Devices, Inc. (NASDAQ: ADI) Location: Bangalore Urban, Karnataka, India Job Type: Internship/Cooperative Job Mode: On-site Job Requisition ID: R243836 Years of Experience: Not required (Internship position for students or fresh graduates) Company Description: Analog Devices, Inc. (ADI) is a globally recognized semiconductor leader, enabling breakthrough technologies at the Intelligent Edge. The company integrates analog, digital, and software technologies to drive advancements in industries such as digitized factories, mobility, and digital healthcare. With a revenue exceeding $12 billion in FY23, ADI has a workforce of approximately 26,000 employees globally. The company serves 125,000 global customers and focuses on fostering innovation through a combination of hardware and software solutions. ADI promotes a culture of work-life balance, continuous learning, and professional growth. The organization values diversity and i...

Remote Entry Level Front End Engineer hiring for one of our clients

Company: One of our Clients (Leading Product Startup in LLM space) Position: Entry Level Front End Engineer (0- 3 years; relevant experience) Location: India - Remote Job ID: TOT521487 Company Overview The startup is at the forefront of creating transformative generative AI products, focusing on making Large Language Model (LLM) intelligence easily accessible to end users. They have set an ambitious milestone to achieve by the end of the year and are looking for passionate individuals to join their innovative team on this exciting journey.   Role Overview We are seeking an enthusiastic Entry-Level Front-End Engineer to join our dynamic development team. This role is perfect for someone who is passionate about generative AI, eager to learn, and ready to contribute in a collaborative team environment. Your contributions will be crucial in helping us achieve our ambitious goals.   Responsibilities Collaboration : Work closely with the founding team to develop stunning, respon...