Explore opportunities across the Comcast Ventures portfolio.

Data Platform Engineer

BigID

BigID

Software Engineering
Chennai, Tamil Nadu, India
Posted on Feb 18, 2025

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for:

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the 2024 Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BIgID as one of the 20 Coolest Identity Access Management And Data Protection Companies Of 2024 (2 years running)
  • DUNS 100 Best Tech Companies to Work For in 2024
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for a Data Platform Engineer to join our ETL team. The ideal candidate will have experience with data engineering to design and maintain our ETL pipelines. You will work closely with cross-functional teams to ensure the scalability and reliability of our data solutions.

Job Summary:

As a Data Platform Engineer, you'll be responsible for the design, development, maintenance, troubleshooting, and implementation of our ETL processes.

What you’ll do:

  • Maintain current solutions based on NodeJS, Snowflake and AWS S3
  • Implement data processing pipelines using Kafka for real-time data streaming.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues promptly to minimize downtime and ensure system reliability.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
  • 5+ years of experience in the software engineering field.
  • Proficiency in NodeJS programming and experience with related frameworks.
  • Proficiency in Java programming and experience with related frameworks.
  • Understanding of data modelling, ETL processes, and data warehousing.
  • Strong knowledge of SQL.
  • Problem-solving abilities and strong analytical skills.
  • A solid understanding of CI/CD principles.
  • Experience working with both external and in-house APIs and SDKs Advantages:
  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure)
  • Full-stack experience is a plus

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  • Equity participation - everyone shares in our success
  • Hybrid work
  • Opportunities for professional growth
  • Team fun & company outings
  • Statutory benefits and leave benefits
  • Health Insurance coverage

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-EV2

BigDiversity: We’re committed to creating a culture of inclusion, diversity, and equality – across race, gender, sexuality, disability, and neurodiversity – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

CPRA Employee Privacy Notice: CA

BigID is an E-Verify Participant.