Senior Data Analytics Engineer (Snowflake/DBT) (1043) - Controller's Office - (168332)

Business Intelligence Platform Change Project

The Controller’s Office is working in a multi-year project to migrate the Reports and Analytics solution into a unified Snowflake-based platform. The BI Platform Change will provide departments with secure, streamlined access to PeopleSoft data, improving efficiency, governance, and standardizing data sharing citywide. By replacing outdated processes, this modern framework supports transparency, accountability, collaboration, better service delivery, strategic growth, and public trust.

Job Description:

This Senior Technology Engineer position will be part of the BI Platform Change project and will work with members of the SF Reports & Analytics Team, Functional Teams and other City and County staff to support the project. The analyst will perform both functional (business process and systems analysis) and technical (report, query and dashboard development, data extract, load and transformation, metadata modeling, tuning, and troubleshooting) tasks.

This position will be instrumental in designing, building, and managing the new business intelligence platform using tools such as dbt, sql, and other tools with a Snowflake database source and target.

Essential duties include but are not limited to: 

• Exercise judgement, decisiveness and creativity in designing, planning, troubleshooting and integration of large complex systems or networks based on the potential benefits and/or consequences.
• Analyze the interrelationships of business processes, complex financial data and systems to develop reporting requirements and data structures.
• Perform fit/gap analysis to evaluate reporting and data needs.
• Define and implement application configuration settings.
• Collaborate with the project team on transition plans for re-engineered business processes.
• Analyze and test security roles and permissions.
• Write functional and technical specifications.
• Design and build solutions based on detailed specifications.
• Develop and execute system and user acceptance test plans and evaluating test results.
• Develop and provide support and training for users in person, on the phone and in workshops.
• Write business and system process and technical documentation.
• Identify, manage and escalate issues and risks throughout software development life cycle.
• Perform other duties as assigned.

Education: An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].

Experience: Three (3) year of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.

Substitution: One year of additional experience as described above may be substituted for the required degree; or Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.

• One-year full-time employment is considered equivalent to 2000 hours (2000 hours of qualifying work experience is based on a 40-hour work week). Any overtime hours that you work above forty (40) hours per week are not included in the calculation to determine full-time employment.
• Applicants must meet minimum qualification requirements by the final filing date unless otherwise noted. 
• Every application is reviewed to ensure that you meet the minimum qualifications as listed in the job ad. Please review our articles on Employment Application and Minimum Qualifications and Verification of Experience and/or Education for considerations taken when reviewing applications. 

DESIRABLE QUALIFICATIONS:

Technical Knowledge

• Three (3) years of experience in the information systems field, including system analysis, business process design, development and implementation of business application solutions or IT project management.
• Two (2) years of hands-on experience administering and developing on Snowflake managed cloud data platform and with Oracle databases
• Two (2) years of Demonstrated expertise in writing advanced, performant SQL, and using dbt for SQL-based data transformation and modeling
• Experience with layered data architecture (staging, intermediate, marts) using dbt best practices to support analytics and reporting use cases including parameterized and dynamic dbt models using Jinja templating to support reusable transformations across multiple datasets and environments
• Hands-on experience in GitHub for code change management and collaboration with other team members
• Hands on experience with Snowflake data warehouse functionality including Snowflake masking native features, Snowpipe, SnowSQL, Snowpark and Snowflake optimization configuration
• Strong skills in Python (with libraries like pandas, PySpark) for data processing and automation
• Experience in building and deploying data pipelines using orchestration tools
• Hands-on experience in real-time data streaming technologies (Snowpipe, GoldenGate)
• Experience building and deploying data pipelines using orchestration tools
• Experience with CI/CD & DevOps a plus
• Experience in development of APIs to interface PeopleSoft data with other enterprise applications
• Deep understanding of data warehouse concepts, data modeling, and modern ETL principles
• Understanding of data governance, data security, and data privacy principles
• Understanding of PeopleSoft applications such as PeopleSoft Financials and Supply Chain Management (FSCM)  or PeopleSoft Capital Human Resources (HCM) experience performing data analysis, design and testing.
• Understanding of OBIA 11g (with ODI 11g), including the following:
  • Oracle ODI Load Plans from PeopleSoft 9.2 FSCM (GL, AP, AR, BI, Contracts, PO, Project Costing) and HCM (Human Resources, Position Management, Time and Labor, Payroll)
• Working with DBAs, BI Dev, PeopleSoft, and Security teams to improve performance and data quality using Agile sessions
• Working knowledge of business process flows used to support a complex accounting system, and experience in developing and executing application test plans.
• Desirable experience of building AI agents

Collaboration and Communication Skills

• Strong problem-solving skills with ability to design practical and effective data solutions
• Excellent verbal and written communication skills, including the ability to explain technical concepts to non-technical stakeholders
• A collaborative mindset with enthusiasm to work across diverse, cross-functional teams

Mission alignment

• Commitment to equity, transparency, and ethical data use
• Passion for public service using data to improve government services

Selection Procedures 

The selection process will include evaluation of applications in relation to minimum requirements. Candidates whose qualifications most closely meet the needs of the Department will move forward in the recruitment process.

Additional Information Regarding Employment with the City and County of San Francisco:

• Information About the Hiring Process
• Conviction History
• Employee Benefits Overview  
• Equal Employment Opportunity
• Disaster Service Worker
• ADA Accommodation
• Right to Work
• Copies of Application Documents
• Diversity Statement

Where to Apply

All job applications for the City and County of San Francisco must be submitted through our online portal. Please visit https://careers.sf.gov/ to begin your application process.

Computers are available for the public (9:00 a.m. to 4:00 p.m. Monday through Friday) to file online applications in the lobby of the Dept. of Human Resources at 1 South Van Ness Avenue, 4th Floor and at the City Career Center at City Hall, 1 Dr. Carlton B. Goodlett Place, Room 110.

Ensure your application information is accurate, as changes may not be possible after submission. Your first and last name must match your legal ID for verification, and preferred names can be included in parentheses. Use your personal email address, not a shared or work email, to avoid unfixable issues.

Applicants will receive a confirmation email from [email protected] that their online application has been received in response to every announcement for which they file. Applicants should retain this confirmation email for their records. Failure to receive this email means that the online application was not submitted or received.

If you have any questions regarding this recruitment or application process, please contact the Nancy Giang at [email protected]. Recruitment ID: RTF0168331-01159491

The City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.