What This Position Is
Integration Team Big data Developer, is responsible for Data streaming program
design, coding, unit testing, integration testing and implementation of Confluent
Kafka programs, primarily using Apache & Confluent Kafka Clusters and Spark
Who You Are:
- You lead by example, and can easily
maintain your composure under pressure
- Your oral and written communication
skills are obviously effective and clear
- You utilize your strong
communication skills to inspire, direct, and lead your team to meet all
You Also Have:
minimum of 4-6 years development experience with at least two years in Big Data
Development; including hands on experience with Kafka,
Apache Spark, Java/Scala, CI/CD, K8s/Container technologies.
understanding of Kafka both Apache and Confluent. Knowledge of concepts of the
pub/sub model, writing producers, consumers and transforming data within a
streaming platform, writing programs using Kafka APIs and Kafka
- Experience with continuous
integration and delivery tools. Must have experience in Dev ops tools like Kubernetes,
Dockers, Jenkins, GIT Repository, Helm Chart.
understand various data formats like JSON, Avro, XML etc
in SQL scripting and data lake concepts.
Bachelor's degree in Information Technology or related field (preferred) or
As the Integration Big
Data Developer, You Will:
Spark jobs in (Scala/Python/Java) in order to stream / publish or consume data
from various sources and data formats.
be good in spark performance tuning techniques.
consumers and producers to work with Kafka topics helping integrate systems and
stream data to upstream and downstream. Ability to perform mapping translations
and allow for high throughput of data via configurations within the Kafka
unit testing, QA, and work with business partners to resolve any issues
discovered during UAT.
peer-review of mappings and workflows when required.
development and test data environments by populating the data based on project
all applicable documentation pertaining to specific SDLC phases
have a proven and quantifiable track-record of success in delivering results
within a large complex organization.
have the ability to quickly assess a new environment and develop solutions that
support the business strategy, critical objectives, and cultural norms.
are creative with a strategic mindset along with the ability to turn concepts
are a change agent who is flexible, resilient, and able to thrive in a dynamic,
rapid paced environment.
embody a culture of taking smart risks and innovating to win.
have strong analytical and problem solving skills.
have the proven ability to work independently in a dynamic environment with
multiple assigned projects and tasks.
oral and written communication skills are obviously effective and clear
Your Life and Career at
part of a world-class team; work with an adventurous spirit; think and act like
to rewarding career advancement opportunities, from retail to supply chain, to
digital or corporate.
culture that promotes a healthy, fulfilling work/life balance.
package for all eligible full-time employees (including medical, vision and
amazing employee discount.