Job Details

Email to Friend Save Back

Data Engineer

SEATTLE-98101, WA, US
11/25/2019

-

Required Skills

Unix shell scripting

Company

Infinity Consulting Solutions, Inc

Experience

3 to 5 Year(s)

Job Description

Responsibilities:

Drive improvements across portfolio of offerings by using data

Work collaboratively with cross-functional teams to develop, drive, and oversee new strategies to ensure
the growth of the business and the overall bottom line

Architect, build and support the analytic technologies that give internal customers timely, flexible and structured access to their data as a means to optimize marketing/scheduling and show development

Interact with team members and internal customers to gather requirements and build robust and secure data flows

Lead the transformation of a peta-byte scale batch-based processing platform to a near real-time streaming platform using technologies such as Apache Kafka, Cassandra, Spark and other open source frameworks

Own the design, creation, and management of extremely large datasets

Design, implement, and operate stable and scalable solutions

Work closely with teams of diverse skills, mindsets and backgrounds

Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using best Standard Practices in data modeling, ETL/ELT processes, and SQL, Python and Snowflake

Requirements:

Bachelor’s degree in Computer Science, Computer Engineering, Business Administration, Mathematics or a related field

5+ years of industry experience as a Data Engineer or related specialty (e.g., Business Intelligence
Engineer, Data Scientist)

3+ years Programming experience manipulating and analyzing data (Python or Scala)

Experience building robust and scalable data integration (ETL) pipelines using Airflow, SQL, Python and Spark

Experience in data modeling, ETL development, and Data warehousing

Data Warehousing Experience with Oracle, Redshift, Teradata, Snowflake etc.

Experience building data products incrementally and integrating and managing datasets from multiple sources

Experience with Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, Apache Druid)

Preferred:

MS, MBA, or PhD a plus from a top institution (Computer Science, Computer Engineering, Business
Administration, Mathematics or a related field)

Experience working in AWS environment preferably AWS Certification

Software engineering mindset and ability to write elegant, maintainable code

Practical Knowledge of Linux or Unix shell scripting

Strong sense of ownership, urgency, and drive

Software development and design