Job posting number: #7183065
Posted: September 27, 2023
Application Deadline: Open Until Filled
Job DescriptionJob Description:
Responsible for designing, building, and maintaining data pipelines and infrastructure. Works closely with university stakeholders to ensure that our data is easily accessible, accurate, and ready for analysis.
PRINCIPAL DUTIES & RESPONSIBILITIES:
Design, build, and maintain scalable and efficient data pipelines to collect, process, and store data from various sources.
Implement ETL (Extract, Transform, Load) processes to ensure data accuracy and consistency.
Continuously optimize and automate data workflows for improved performance and reliability.
Integrate data from internal and external sources, including databases, APIs, and third-party services.
Ensure seamless data flow between different systems and platforms.
Establish data quality standards and procedures to identify and resolve data anomalies, inconsistencies, and errors.
Implement data validation and data cleansing techniques.
Collaborate with data architects to define data structures, data models, and schema designs.
Help shape the long-term data strategy and architecture for the organization.
Maintain comprehensive documentation of data pipelines, processes, and data dictionaries.
Ensure knowledge transfer and provide documentation for end-users.
Collaborate closely with analysts, and other cross-functional teams to understand data requirements and deliver data solutions.
Participate in agile development methodologies and team meetings.
Other duties as assigned.
Working after hours and on weekends to complete assigned tasks is sometimes required.
KNOWLEDGE AND SKILLS NEEDED:
Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
Proven experience as a Data Engineer or similar role.
Proficiency in data warehousing concepts and tools (e.g., SQL, Synapse, Snowflake, Redshift).
Strong programming skills in languages like SQL, C#, and Python.
Experience with ETL tools and data integration technologies.
Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
Excellent problem-solving and communication skills.
Ability to work independently and collaboratively in a fast-paced environment.
Preferred experience working in a higher education setting.