Big Data Engineer

Company: 24-7 Intouch
Location: Clearwater
Posted on: May 12, 2022

Job Description:

About 24-7 Intouch

24-7 Intouch is a global customer care and technology company that provides value-driven, future-forward solutions. For over 20 years, we have been the people and technology behind the world's biggest brands, empowering human potential through our artificial intelligence division, Laivly, and driving change for our client partners through actionable insights and analytics.

For more on our culture, follow the link to Our Story - https://youtu.be/a6CvsUKYN8g

About The Job

Big Data Engineers serve as the backbone of the Strategic Analytics organization, ensuring both the reliability and applicability of the team's data products to the entire program. They have extensive experience with ETL design, coding, and testing patterns, as well as, engineering software platforms and large-scale data infrastructures. The incumbent has the capability to architect highly scalable end-to-end pipelines using different open source tools, including building and operationalizing high-performance algorithms.

Big Data Engineers understand how to apply technologies to solve big data problems with expert knowledge in programming languages like Java, Python, Linux, PHP, Hive, Impala, and Spark.

The ideal candidate implements complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable deliverables across customer-facing platforms. They have a strong aptitude to decide on the needed hardware and software design and can guide the development of such designs through both proof of concepts and complete implementations.

As Big Data Engineer, You Will---

• Translate complex functional and technical requirements into detailed design
• Design for current and future success
• Hadoop technical development and implementation
• Load from disparate data sets by leveraging various big data technology e.g. Kafka
• Provide pre-process using Hive, Impala, Spark, and Pig
• Design and implement data modeling
• Maintain security and data privacy in an environment secured using Kerberos and LDAP
• High-speed querying using in-memory technologies such as Spark
• Follow and contribute best engineering practice for source control, release management, and deployment
• Production support, job scheduling/monitoring, ETL data quality, and data freshness reporting
• Tune Hadoop solutions to improve performance and end-user experience
• Document requirements as well as resolve conflicts or ambiguities
  
  Requirements
  
  As Big Data Engineer, You Have---
  
  • Completed Bachelors and/or Masters degree in Computer Science or Engineering
  • 5-8 years of experience writing complex SQL queries
  • 3+ years of Python development experience
  • 3+ years of demonstrated technical proficiency with Hadoop and big data projects
  • 3+ years of demonstrated experience and success in data modeling
  • Ability to automate and implement ETLs to reduce manual work
  • Fluent in writing shell scripts [bash, korn]
  • Experience writing high-performance, reliable and maintainable code
  • Familiarity with and implementation knowledge of loading data using Sqoop
  • Knowledge and ability to implement workflow/schedulers within Oozie
  • Experience working with AWS components [EC2, S3, SNS, SQS]
  • Analytical and problem solving skills, applied to Big Data domain
  • Proven understanding and hands on experience with Hadoop, Hive, Pig, Impala, and Spark
  • Good aptitude in multi-threading and concurrency concepts
  • Proficient in designing efficient and robust data workflows
  • Experience working in teams and collaborate with others to clarify requirements
  • Strong coordination and project management skills to handle complex projects
  • Excellent oral and written communication skills
    
    Ready to apply? Submit your application and one of our recruiters will reach out via email/phone/text to learn more about you and connect you to this exciting opportunity!
    
    24-7 Intouch is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, arrest and conviction records, or any other characteristic protected by law. 24-7 Intouch will comply with all local fair chance ordinances."
    
    Any applicant who, because of a disability, needs accommodation or assistance in completing an application or at any time during the application process should contact the Recruiting department and/or the Human Resources department. 24-7 Intouch also provides reasonable accommodations to employees with disabilities consistent with its obligations under the law.
    
    By signing this application, the applicant consents to 24-7 Intouch collecting, using and retaining his\her personal information for purposes relating to the application process and if hired, the employment relationship. Any and all personal information collected is held in the strictest confidence and in accordance with all applicable Privacy Laws.
    
    U.S Department of Labor Posters

Keywords: 24-7 Intouch, Clearwater , Big Data Engineer, Engineering , Clearwater, Florida