Senior Databricks Engineer at Tredence

Short Description:

Tredence, a leading analytics and data science company, is hiring a Senior Data Engineer with 3-6 years of experience for roles in Bangalore, Chennai, Delhi, Pune, and Kolkata. The candidate will be responsible for developing advanced Data Warehouse solutions using Databricks and AWS/Azure Stack, collaborating with DW/BI leads, and addressing ETL pipeline development requirements. Strong skills in SQL, Python, and Spark (PySpark) are essential, along with experience in AWS/Azure stack. The ideal candidate should have expertise in data modeling, Databricks Data & AI platform, and proficiency in managing structured and unstructured data.

Job Title: Senior Databricks Engineer

Organization: Tredence

Position: Senior Data Engineering Professional (3-6 years experience)

Work Locations: Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence:

Tredence is dedicated to delivering impactful insights that drive profitable actions by integrating business analytics, data science, and software engineering. We collaborate with major companies across various sectors, deploying predictive and optimization solutions at scale. Headquartered in the San Francisco Bay Area, our clientele spans the US, Canada, Europe, and South East Asia. We are in search of an accomplished data scientist who not only possesses the required mathematical and statistical expertise but also exhibits natural curiosity and a creative mindset to explore, connect, and unveil hidden opportunities, ultimately unlocking the full potential of data.

Primary Roles and Responsibilities:

Develop advanced Data Warehouse solutions utilizing Databricks and AWS/Azure Stack.
Offer forward-thinking solutions in the realm of data engineering and analytics.
Collaborate with DW/BI leads to comprehend new ETL pipeline development requirements.
Identify gaps in existing pipelines and rectify issues efficiently.
Work closely with the business to understand reporting layer needs and develop data models accordingly.
Assist team members in resolving issues and technical challenges.
Lead technical discussions with client architects and team members.
Orchestrate data pipelines in scheduler via Airflow.

Skills and Qualifications:

Bachelor's and/or master’s degree in computer science or equivalent experience.
Minimum of 3 years of IT experience and 3+ years' hands-on experience in Data warehouse/ETL projects.
Profound understanding of Star and Snowflake dimensional modeling.
Robust knowledge of Data Management principles.
Thorough understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
Hands-on experience in SQL, Python, and Spark (PySpark).
Experience in AWS/Azure stack is mandatory.
Desirable skills include ETL with batch and streaming (Kinesis).
Proficiency in building ETL/data warehouse transformation processes.
Familiarity with Apache Kafka for streaming data/event-based data.
Exposure to Open-Source big data products, including Hadoop (incl. Hive, Pig, Impala).
Familiarity with Open Source non-relational/NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
Experience with structured and unstructured data, including imaging & geospatial data.
Proficient in working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
Experience working in Agile methodology.
Strong verbal and written communication skills.
Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/PySpark/Spark with Azure/AWS Databricks

Please click here to apply.

Comments

Other popular job openings

Rolls-Royce is hiring for a Data Analyst Intern role in India

Position: Intern, Data Analytics Company: Rolls-Royce Power Systems Location: Pune, India Job Type: Full-time Internship Job Mode: Onsite Job Requisition ID: JR6138986 Years of Experience: Open for college students and for people with 0 to 3 years Company Description Rolls-Royce Power Systems, a part of Rolls-Royce Group, specializes in advanced power and propulsion solutions. The division is headquartered in Friedrichshafen, Germany, and has a workforce of around 9,000 professionals globally. It operates under the mtu brand and offers high-speed engines, complete propulsion systems, and digital energy solutions. These offerings are essential across various industries including marine, rail, defense, power generation, and oil & gas. The product suite covers diesel and gas engines, battery energy storage systems, microgrids, and hybrid systems. The company emphasizes cleaner technologies, innovation, and electrification to meet growing e...

Bain & Company is hiring for an fresher entry level Data Analyst role in India

Position: Data Analyst, D&I Consumer Lab Company: Bain & Company Location: Gurugram, Haryana, India Job type: Full-time Job mode: Hybrid Job requisition id: Not specified Years of experience: 0 to 1.5 years (0–18 months) Company description Bain & Company is a global management consulting firm known for working closely with leading businesses, governments, and institutions to drive sustainable and measurable outcomes. With a presence in 65 cities across 40 countries, Bain brings together people, knowledge, and advanced analytics to provide transformative strategies that fuel success. Since its founding in 1973, Bain has built a reputation for delivering results-driven consulting, maintaining a culture of client advocacy, and standing out as a leader in innovation. In India, Bain began operations in 2004 through the Bain Capability Network (BCN), originally known as the Bain Capability Center. BCN supports Bain’s global consulting effor...

Optum is hiring for an fresher entry level AI/ML Engineer role in India

Position: AI/ML Engineer Company: Optum (a part of UnitedHealth Group) Location: New Delhi, Delhi, India Job type: Full-time Job mode: Onsite Job requisition id: 2283519 Years of experience: 0–3 years Company description Optum is a global health services company that belongs to the UnitedHealth Group family. The company works across the healthcare ecosystem to improve outcomes, reduce costs, and deliver insights using data and technology. They specialize in areas such as pharmacy care services, healthcare delivery, data analytics, and technology-driven solutions for both individuals and organizations. Optum is focused on transforming the healthcare experience by providing tools and services that make systems more efficient and effective. Its workforce includes clinicians, data scientists, engineers, and experts from a wide range of fields. With innovation at its core, Optum continually builds digital platforms and data-driven tools that red...

Frido is hiring for a Data Analyst Intern role in India

Position: Data Analyst Intern Company: Frido Location: Pune, Maharashtra, India Job type: Internship Job mode: Onsite Job requisition id: Not provided Years of experience: 0-2 years Company description Frido is a wellness and fitness company that specializes in developing innovative products to enhance daily life. Their mission focuses on empowering people to lead a pain-free life through ergonomically designed solutions. Frido’s product lineup includes items such as supportive wheelchairs, comfortable shoe inserts, and ergonomic seat cushions. These products have achieved recognition on major online platforms, including Amazon’s Choice and Bestseller tags in India. The company believes in constant innovation, always seeking new ways to help individuals improve their comfort in daily activities. Frido values accessibility and practical solutions, working to make life easier for a wide range of people. Their team consists of committed indi...

Cushman & Wakefield is hiring for a fresher entry level Data Analyst role in India

Position: Data Analyst Company: Cushman & Wakefield Location: Gurgaon, India Job type: Full-time Job mode: On-site Job requisition id: R276441 Years of experience: 0–3 years Company description Cushman & Wakefield is a globally recognized name in real estate services, operating in more than 60 countries. With over 52,000 employees and nearly 400 offices worldwide, the company serves clients with high standards in real estate strategy, operations, and transactions. In 2023 alone, Cushman & Wakefield generated $9.5 billion in revenue, indicating both scale and trust in its offerings. The company works with building owners, occupiers, and investors to help them maximize property value through tailored solutions. Cushman & Wakefield is publicly traded on the New York Stock Exchange under the ticker symbol CWK. Their work spans multiple real estate domains, including asset services, capital markets, facility services, global occupier services,...

GE Aerospace is hiring for an fresher entry level Data Scientist role in India

Position: Data Scientist (Data Science Specialist) Company: GE Aerospace Location: Bengaluru, Karnataka, India Job type: Full-time Job mode: Onsite Job requisition id: R5011274 Years of experience: 0-3 years

Campus Ambassador Program at TakeOff Talent for College Students

Position: Campus Ambassador Company: TakeOff Talent Location: Pan-India (Remote-friendly; open to all colleges) Job Type: Part-time, Volunteer-based About TakeOff Talent: TakeOff Talent is a student-focused platform that helps college students find their unique career paths with practical tools, mentorship, and community support. Our vision is to ensure every student, regardless of their college or background, feels confident and equipped to build a fulfilling career. Program Overview: The Campus Ambassador Program at TakeOff Talent is a 6 months to 1 year-long journey designed to nurture student leaders who will play a key role in extending our mission across their campuses. Ambassadors act as connectors, sharing opportunities, and helping peers access resources that make a difference. Who We’re Looking For: We’re looking for students who are proactive, authentic and excited about learning new things. If you’re someone who likes to take the lead in creating supportive env...

Mastercard is hiring for a fresher entry level Data Analyst role in India

Position: Data Analyst (Analytics & Metrics) This is a full-time entry-level position focusing on analytics and metrics within Mastercard’s Global Business Services Center (GBSC). The role involves working with large datasets, building data visualizations, and supporting strategic business decisions through data analysis. Company: Mastercard A global leader in payments technology with a presence in over 200 countries and territories. Committed to driving economic growth and providing innovative payment solutions. Works with governments, businesses, and individuals to build a more sustainable and inclusive digital economy. Location: Pune, India Postal code 411006 Located in a key technology and business hub known for its dynamic talent pool and vibrant tech community. Job type: Full-time Offers comprehensive exposure to data analytics in a corporate environment. Emphasis on skill development, innovation, and cross-functional collaboration. Job mode:...

Softsensor.ai is hiring for an fresher entry level Associate Data Scientist (Analytics) role in India

Position: Associate Data Scientist (more of a Data Analyst role as per the roles and responsibilities) Company: Softsensor.ai Location: Gurgaon or Jaipur (India) Job type: Full-time Job mode: Onsite Job requisition id: Not specified Years of experience: 0 - 3 years (internship experience is preferred) Company description: Softsensor.ai is an innovative organization based in both the USA and India, focusing on using data-driven approaches to help clients solve business challenges. It combines the expertise of its team, proven methodologies, and technological accelerators to deliver solutions effectively and quickly. The company’s team has significant experience in data science and analytics, collaborating with global consulting firms and multinational corporations to build large-scale solutions. Softsensor.ai uses data science to boost organizational performance, helping clients find insights that improve their decision-making processes. They appl...

Airtel is hiring for an fresher entry level Business Analyst role in India

Position: Business Analyst Company: Airtel Location: Gurugram, Haryana, India Job type: Full-time Job mode: Onsite Job requisition id: Not specified Years of experience: 0-3 years Company description: Airtel, known as Bharti Airtel Limited, is one of India’s top telecommunications service providers, offering a range of innovative products and services. Headquartered in New Delhi, Airtel operates in 18 countries across Asia and Africa, supporting a customer base of over 574 million as of 2023. The company is a pioneer in digital transformation, with a solid presence in 5G technology, IoT solutions, and digital payment services, playing a key role in the country’s digital revolution. Airtel’s extensive infrastructure includes over 388,000 route kilometers of optical fiber and a distribution network spanning nearly every town and village across India. Sustainability is a priority, with the Green 5G Initiative leading efforts to reduce carbon emission...

Please enter your query here