brand logo
View All Jobs

GCP Big Data Engineer

Chennai, Bangalore, Hyderabad
Job Description
About the role:

We are looking for a Senior Data Engineer to be based out of our Chennai office. This role involves a combination of hands-on contribution, customer engagement, and technical team management. 

As a Senior Data Engineer, you will

● Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.
● Set up and run Hadoop development frameworks.
● Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.
● Explore and learn new technologies for creative business problem-solving.
#LI-UNPost
Job Requirement
Required Experience, Skills & Competencies:

● Ability to develop and manage scalable Hadoop cluster environments
● Ability to design solutions for Big Data applications
● Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
● Working experience on Big Data services in a GCP cloud-based environment.
● Experience in Spark, Pyspark, Python or Scala, Kafka, Akka, core or advanced Java, and Databricks
● Knowledge of how to create and debug Hadoop and Spark jobs
● Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop    distribution
● Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL
● Familiar with data visualization tools like Tableau
● Good communication and interpersonal skills
● Minimum 4-8 years of Professional experience with 3+ years of Big Data project experience
● B.Tech/B.E from reputed institute preferred
#LI-UNPost