1+ months

Senior Data Engineer - P208462

Chicago, IL 60602
Apply Now
Apply on the Company Site
  • Job Code
\u003Cp\u003EAt Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. \u003Cstrong\u003EWe\u0027re all about people, and our employees are why Discover is a great place to work. \u003C/strong\u003EBe the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career.\u003C/p\u003E\u003Cp\u003EDiscover Financial Services is seeking a Senior Data engineer to join our Data Operations team. Successful candidates will partner with our business partners to understand their data needs, and build data pipelines using cutting edge technologies. Additionally, you will provide engineering leadership to create and enhance data solutions enabling seamless integration and flow of data across our data ecosystem. You will provide lead level technical consulting to peer data engineers during design and development for highly complex and critical data projects. Some of these projects will include designing and developing data ingestion and processing/transformation frameworks leveraging AWS and open source tools such as Java, Python, Spark, Scala, Hive, Python, etc.\u003C/p\u003E\u003Cp\u003E\u003Cstrong\u003EResponsibilities\u003C/strong\u003E\u003C/p\u003E\u003Cul\u003E\u003Cli\u003EDesigns and develops data ingestion frameworks, real-time processing solutions, and data processing/transformation frameworks, leveraging open-source tools.\u003C/li\u003E\u003Cli\u003EProvides senior-level technical consulting to peer-data engineers during design and development for highly complex and critical data projects\u003C/li\u003E\u003Cli\u003EDeploys application codes and analytical models using CI/CD tools and techniques and provides support for deployed data applications and analytical models.\u003C/li\u003E\u003Cli\u003EProvide system support as part of a support rotation with other team members.\u003C/li\u003E\u003Cli\u003EBe part of Data Engineering team translating business and technology requirements into our ETL/ELT architecture.\u003C/li\u003E\u003Cli\u003ECollaborate with cross functional teams such as AWS cloud \u0026 platform engineering, DBAs and business teams.\u003C/li\u003E\u003Cli\u003EDesign and develop real-time and batch data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Kinesis, Java, NoSQL DBs, AWS EMR.\u003C/li\u003E\u003Cli\u003EDevelop data driven solutions utilizing current and next generation technologies to meet evolving business needs.\u003C/li\u003E\u003Cli\u003EAbility to quickly identify an opportunity and recommend possible technical solutions.\u003C/li\u003E\u003Cli\u003EDevelop Custom Data pipeline (Cloud and locally hosted).\u003C/li\u003E\u003Cli\u003EProvide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.\u003C/li\u003E\u003Cli\u003EProvide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.\u003C/li\u003E\u003Cli\u003EEnsure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.\u003C/li\u003E\u003C/ul\u003E \u003C/p\u003E\u003Cp\u003E \u003Cp\u003E\u003Cstrong\u003EMinimum Qualifications\u003C/strong\u003E\u003C/p\u003E\u003Cp\u003E\u003Cstrong\u003EAt a minimum, here\u0027s what we need from you:\u003C/strong\u003E\u003C/p\u003E\u003Cul\u003E\u003Cli\u003EBachelor\u0027s Degree in Computer Science, or related field\u003C/li\u003E\u003Cli\u003E2\u002B years of experience in Data Platform Administration/Engineering\u003C/li\u003E\u003C/ul\u003E \u003C/p\u003E\u003Cp\u003E \u003Cbr\u003E\u003Cp\u003E\u003Cstrong\u003EPreferred Qualifications\u003C/strong\u003E\u003C/p\u003E\u003Cp\u003E\u003Cstrong\u003EIf we had our say, we\u0027d also look for:\u003C/strong\u003E\u003C/p\u003E\u003Cul\u003E\u003Cli\u003E4\u002B years of experience in Data Platform Administration/Engineering\u003C/li\u003E\u003Cli\u003EExperienced in Agile/Lean/SAFe methodologies.\u003C/li\u003E\u003Cli\u003EProficiency in one of the scripting languages such as Shell/Python/Scala/Java.\u003C/li\u003E\u003Cli\u003EGood understanding of Big Data technology trends, with knowledge of technologies such as Kinesis, Kafka, Spark, Hive, and Python.\u003C/li\u003E\u003Cli\u003EExperience with one of the ETL tools Abinitio, Informatica or Data Stage.\u003C/li\u003E\u003Cli\u003EHands on experience with AWS based solutions such as RDS, Lambda, DynamoDB, Redshift, Snowflake or S3.\u003C/li\u003E\u003Cli\u003EExperience in building \u0026 utilizing tools and frameworks within the Big Data ecosystem including Kafka, Spark, HBase, NoSQL.\u003C/li\u003E\u003Cli\u003EExperience with relational databases such as MySQL or Postgres and understanding of columnar data stores such as Redshift or Snowflake; and expert skills in writing complicated SQL statements.\u003C/li\u003E\u003Cli\u003EAbility to work in a fast-paced, rapidly changing environment.\u003C/li\u003E\u003Cli\u003EExperience within the financial industry \u003C/li\u003E\u003Cli\u003EAWS Cloud Services certification \u003C/li\u003E\u003C/ul\u003E#LI-KE \u003C/p\u003E \u003Cp\u003E The same way we treat our employees is how we treat all applicants - with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity \u0026 inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover. \u003C/p\u003E \u003Cbr\u003E\u003Cbr\u003E



  • Banking / Finance
Posted: 2019-10-08 Expires: 2019-12-12

Welcome to Discover
We strive to be the leading direct bank and payments services company. Our mission is to help people spend smarter, manage debt better, and save more to achieve a brighter financial future.

Why Work with Us?
You can make an impact. Whether it’s developing corporate strategy, innovating new services or supporting IT needs, every employee has the opportunity to be a vital part of our business and make a real difference in people’s lives. It’s the heart of what we do.


Featured Employers[ View All ]

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Senior Data Engineer - P208462

Chicago, IL 60602

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast