**Job Purpose**The Data Engineer will build and operate our enterprise data platform, prepare and deliver curated datasets for operational and analytical use cases. DE will design and provide analytical datasets to citizen data analysts, prepare training data and extract features to accelerate data science model development.In a complex enterprise data environment with numerous systems of record and systems of engagement, the Data Engineer will ensure that the Data Engineering services are delivered in a scalable, reliable, secure, and maintainable manner to support the service levels. The Data Engineer works closely with the Data Architects, System Architects, and Application Architects to align with the Architectural direction of the enterprise and will be required to understand the Architectural landscape and possess the ability to gather and analyze business requirements. In addition, the Data Engineer promotes data sharing across the enterprise while maintaining the accuracy, consistency, integrity, and security of the data sets in the Enterprise Data Repository.**Essential Job Duties & Responsibilities**+ Liberates data from data sources into the enterprise data lake and operational data stores.+ Maps data from the source systems into curated entities and their functional views.+ Implements master data management strategies.+ Designs, implements and deploys data pipeline solutions with data lineage capabilities using Azure Data Factory and Databricks.+ Manages and publishes curated data sets.+ Works with the business to manage data quality.+ Monitors availability, performance, capacity, continuity, security, and service levels of the enterprise data platform and its services.+ Provides subject matter expertise to other technical teams leveraging services from the enterprise data platform.+ Delivers and provides production support for Data Engineering services that meet performance standards and service level agreements.+ Participates in continually improving processes and procedures for enhancing the efficiency and effectiveness of Data Engineering services to analytic users.+ Participates in leveraging emerging innovations related to Data Engineering and work closely with Enterprise Architecture and other teams to operationalize them.+ Supports the Data Engineering department in conducting user groups and other forums as needed to evangelize and promote the adoption of Data Engineering best practices for accessing and using data sets efficiently, effectively, and securely.+ Supports enterprise initiatives in building a culture of data-driven decisions to contribute to operational excellence.+ Participates in the development of Data Engineering practices focusing on long-term sustainability, reuse, and technical debt reduction in the domain of data management.+ Works with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.+ Publishes dashboards that summarize the utilization of data sets in delivering business value impact.+ Supports enterprise architecture function in establishing Policies, Standards, Architecture Patterns, Guidelines, and Best Practices related to Data Engineering discipline. Designs, implements and identifies internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability.**Other duties**+ Supports the Enterprise Data Repository operations as needed in non-production environments.+ Develops tools to automate Enterprise Data Repository operations as needed and liaises with the Service Operations teams that manage production environments.+ Other duties as assigned.**Knowledge, Skills & Abilities**+ Expertise in programming, debugging, and testing utilizing various programming languages, tools and technologies related to Data Engineering.+ Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.+ Experience working with various operating systems, RDB platforms, NoSQL platforms, Big Data platforms, and environments for managing Data over its full lifecycle.+ Strong knowledge of how to compose and implement structural data models.+ Strong knowledge of using data as an enterprise asset – building and managing data marts and data warehouses.+ Proven Experience in managing structured data (application data bases, operational data stores, data marts and data warehouses).+ Experience in managing structured data, unstructured data, and big data at scale on cloud platforms, preferably on Microsoft Azure.+ Experience in managing large-scale storage solutions, preferably using Microsoft Azure.+ Experience molding fresh environments into cost-efficient, high performance, secure, and mature data platforms.+ Understanding of data security concepts including encryption at rest and in transit.+ Familiarity with data visualization techniques and tools.+ Flexible with a strong sense of urgency.+ Ability to effectively communicate technical issues both verbally and in writing.+ Ability to work in an Agile Scrum and Kanban environment.+ Excellent analytical and problem-solving skills.+ Experience in successfully managing large-scale data ecosystems preferred.+ Willingness to use of new software aids and programming techniques that are adopted within IT as needed for the role.**Education and Experience Required**+ Bachelor’s degree in Computer Science or equivalent education.+ 5-7 years of experience in information technology systems or data services delivery.+ 3+ years of overall experience in designing and delivering Data Engineering services using programming/scripting languages such as Python, Scala, R, SQL, C#, Java, or U-SQL.+ 1+ year(s) experience in delivering Data Engineering services using a NoSQL platform such as Cosmos DB, Mongo DB, Hadoop, CouchBase, or HDInsights.+ Experience in using ETL/ELT, Data Quality Management, Meta Data Management, and Master Data Management platforms is highly preferred.+ Azure Data Engineer certification strongly preferred.+ Experience with Microsoft Azure Data Management Platform is strongly preferred.+ Familiarity with the financial services and/or life insurance industry is preferred._The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not to be construed as an exhaustive list of all job duties performed by the personnel so classified._We don’t just accept difference – we celebrate it, we support it, and we thrive on it for the benefit of our employees, our products and our community. Jackson is proud to be an equal opportunity workplace. The Company subscribes to and endorses federal and state laws and regulations relating to equal employment opportunity for all persons without regard to race, color, religion, gender, age, national origin, legally-recognized disability, marital status, legally-protected medical condition, citizenship, ancestry, height, weight, sexual orientation, veteran status, or any other factor not related to the needs of the job. The Company is committed to a policy of equal opportunity. Company facilities and campuses are tobacco-free environments.
from Up Nashville https://ift.tt/v6qB8oH
via IFTTT
Nashvillejobs 