David H.

Data Engineer

With two decades of experience, David serves as a highly-skilled Senior Data Engineer and Database Administrator proficient in managing MySQL, Oracle, and SQL Server systems.

David has effectively overseen large-scale production environments throughout his career, implemented robust disaster recovery solutions, and automated critical processes.

David's proficiency extends to performance tuning, data management, and database health monitoring, leveraging tools like DataDog, Nagios, and Munin.

He also possesses expertise in scripting and programming languages such as Bash, PHP, and SQL and has a proven track record of leading teams and delivering projects on schedule.

With his solid technical knowledge and strategic problem-solving abilities, David is a valuable asset to any organization.

Main expertise

  • CSV 18 years
  • Data Engineering 15 years
  • ETL
    ETL 15 years

Other skills

  • Snowflake
    Snowflake 1 years
  • Python
    Python 1 years
  • Google Cloud
    Google Cloud 1 years
David

David H.

Canada

Get started

Selected experience

Employment

  • Database Administrator

    LexisNexis Risk Solutions - 2 years

    • Managed and maintained critical database systems on a contract basis.
    • Ensured high availability, performed performance tuning, and maintained database security.
    • Monitored database health, executed backups, and supported disaster recovery processes.
    • Collaborated with cross-functional teams to optimize data workflows and support business operations.

    Technologies:

    • Technologies:
    • MySQL MySQL
    • SQL SQL
    • Oracle Oracle

  • Data Engineer

    Pason Systems Inc. - 15 years 8 months

    • Managing MySQL Percona production servers in a 26TB replicated environment for drilling data, encompassing thousands of databases (with millions of tables).
    • Automating balancing a sharded database system, transferring heavily used databases to nodes with lighter volumes, and archiving older data (over 200 databases daily).
    • Ensuring the high availability of databases through ProxySQL and Orchestrator.
    • Establishing geographically dispersed database instances for disaster recovery.
    • Conducting monthly tests for recovery point and recovery time objectives using Terraform.
    • Utilizing DataDog for alerts, monitoring database health, analyzing query performance, and managing automated jobs.

  • Senior Database Administrator (MySQL)

    Pason Systems Inc. - 13 years 8 months

    • Managed MySQL Percona production servers in a 26TB replicated environment for drilling data, encompassing thousands of databases and millions of tables.
    • Automated the balancing of a sharded database system by redistributing heavily used databases to lower-volume nodes and archiving older data, processing over 200 databases daily.
    • Ensured high availability of databases through the implementation of ProxySQL and Orchestrator.
    • Established geographically distributed database instances to support disaster recovery and business continuity.
    • Conducted monthly testing of recovery point and recovery time objectives using Terraform.
    • Utilized DataDog for alerting, database health monitoring, query performance analysis, and automated job management.

    Technologies:

    • Technologies:
    • MySQL MySQL
    • Terraform Terraform
    • InfluxDB InfluxDB
    • DataDog DataDog
    • ELT
    • Tableau Tableau
    • Puppet

  • Data Engineer

    Echostar Technologies - 1 year 7 months

    • Managing 5 MySQL production servers in a 10-terabyte replicated environment, recording set-top box health data, which grows at 14 to 17 gigabytes daily.
    • Creating a database alert system to monitor database and server health, master/slave balance, data integrity, benchmarking, and profiling.
    • Creating and approving database, table, and query structures for embedded SQLite systems used in millions of set-top boxes.
    • Overseeing and assisting with all other MySQL instances used in different departments.
    • Creating and teaching SQL courses for employees who interface with SQL.

  • Database Administrator

    Echostar Technologies - 1 year 7 months

    • Managed five MySQL production servers in a 10TB replicated environment recording set-top box health data, with daily growth of 14–17GB.
    • Maintained and updated the data warehouse; modeled and designed new tables in production; optimized existing tables to meet reporting needs and improve performance (up to 30× faster in some cases).
    • Created a comprehensive database alert system to monitor server health, master/slave balance, data integrity, benchmarking, and profiling.
    • Designed and approved database, table, and query structures on embedded SQLite systems deployed in millions of set-top boxes.
    • Oversaw and supported all MySQL instances used across various departments.
    • Developed and delivered SQL training courses for employees interacting with databases.

    Technologies:

    • Technologies:
    • MySQL MySQL
    • Oracle Oracle
    • SQLite SQLite

  • Data Engineer

    SubscriberBASE - 1 year 1 month

    • Managed 11 MySQL servers, which included 7 secondary servers in a replicated environment for an online media company.
    • Utilized Nagios, Munin, Trac, and MySQL proxy for performance monitoring, data management, server tuning, load balancing, backup and recovery, user profiles, and project management.
    • Developed a database panel to monitor database and server health, perform benchmarking, and conduct profiling.
    • Completed a LAMP-based data warehouse application with a report builder and fully automated ETL processes.

  • Database Administrator

    SubscriberBASE - 1 year 1 month

    • Managed 11 MySQL servers, including 7 secondary servers in a replicated environment for an online media company.
    • Utilized Nagios, Munin, Trac, and MySQL Proxy for performance monitoring, data management, server tuning, load balancing, backup and recovery, user management, and project oversight.
    • Developed numerous automated data management scripts using Bash and PHP.
    • Modified server configurations to boost performance for business units and streamline data management.
    • Created a database panel to monitor server and database health, benchmarking, and profiling.
    • Built a LAMP-based data warehouse application with a report builder and fully automated ETL processes.

    Technologies:

    • Technologies:
    • PHP PHP
    • MySQL MySQL
    • Bash Bash
    • ETL ETL

  • Database Administrator

    Excel Telecom - 11 months

    • Administered MySQL, Oracle, SQL Server, and Sybase databases in an 8TB environment.
    • Conducted performance benchmarking and tuned MySQL to improve system performance.
    • Resolved issues related to I/O contention, file operations, memory management, and stored procedures.
    • Played a key role in migrating data from multiple Oracle and Sybase instances to a MySQL replication setup handling millions of daily transactions.
    • Developed numerous stored procedures and automated scripts in Bash and PHP for database monitoring, data management, user management, backup and recovery, and ensuring 24/7 availability.

    Technologies:

    • Technologies:
    • PHP PHP
    • MySQL MySQL
    • SQL SQL
    • Oracle Oracle
    • Bash Bash
    • PL/SQL PL/SQL

  • SQL Database Administrator / Programmer

    FilmStew - 6 years 2 months

    • Managed a small programming team, editorial team, data entry team, and contracted graphic designers to support FilmStew.com operations.
    • Administered SQL Server and MySQL databases, handling creation, normalization, optimization, warehousing, security and encryption, backup and recovery, tuning, and activity monitoring.
    • Developed the website using storyboards, translating requirements into tasks, performing QA/testing, and managing programming projects.
    • Utilized PHP, Classic ASP, JavaScript, XML, AJAX, and HTML for web development.
    • Built a content management system and accountability reporting tools for data entry processes.
    • Oversaw daily email, networking, internal and web security, and server management.

    Technologies:

    • Technologies:
    • PHP PHP
    • MySQL MySQL
    • JavaScript JavaScript
    • HTML HTML
    • SQL SQL
    • Ajax Ajax
    • XML XML

Education

  • BSc.BA

    University of Calgary · 1989 - 1992

Find your next developer within days, not months

In a short 25-minute call, we would like to:

  • Understand your development needs
  • Explain our process to match you with qualified, vetted developers from our network
  • You are presented the right candidates 2 days in average after we talk

Not sure where to start? Let’s have a chat

First developer starts within days. No aggressive sales pitch.