Skip to main content
Learning Center
Workflow Automation

Practical Workflow Automation

Build a job that runs without you watching it. Map a workflow before automating it, keep every change safe to re-run, organise files and process everyday records, work with a service that is sometimes unavailable, and notice when the job stops running at all. Assumes basic Python functions, loops, and dictionaries. Approximately 8-12 hours including practice, an unvalidated planning estimate rather than a measured completion time.

Modules
6
Lessons
18
Estimated time
About 8 hours of lessons
Before you start
Assumes basic Python: functions, loops and dictionaries.

Times are planning estimates from each lesson's stated length, not measured completion times.

Reading and practice are open to everyone. Saving your progress needs an account with access to this course.

What the practice looks like

Workflow AutomationSample from Failing Halfway, and Starting From There
  1. In A batch of records, plus what the previous run finished
  2. Each record
    • Finished by the previous run: Skip it
    • Handled successfully: Add it to processed
    • Rejected for good (RecordRejected): Quarantine it and keep going
    • Service unavailable or timed out: Retry, at most 2 attempts in all, then stop the run as "partial"
  3. Out A run record: status, processed, skipped, quarantined and reason

Course roadmap

Modules are in the recommended order, and every lesson is open from day one.

  1. Plan an Automation

    Decide what is worth automating, write down what one run consumes and produces, and prove the plan with a dry run before anything changes.

    1. Mapping a Workflow Before You Automate ItStart here25 min
    2. The Run Contract: Inputs, Outputs, and Refusing to Start25 min
    3. The Dry Run That Tells You What Would Happen30 min
  2. Organize Files

    Read a folder without being fooled by it, plan renames that cannot collide, and tell a duplicate file from one that merely shares a name.

    1. Reading a Folder Without Being Fooled By It25 min
    2. Renaming Files Without Losing One30 min
    3. Duplicates: Same Name, Same Size, Same File?25 min
  3. Process Everyday Data

    Read a batch of records without trusting the shape it arrived in, let a bad record fall out of the run instead of stopping it, and turn what is left into a report whose numbers add back up to the count you started with.

    1. Reading Records That Disagree With What You Were Told25 min
    2. Validating a Batch Without Stopping It30 min
    3. Summary Reports Someone Actually Reads at 8am25 min
  4. Connect Services

    Work with a service you cannot supervise: give every run a request budget and a deadline, test against responses you recorded rather than a network, and page through results without ever making an unbounded number of requests.

    1. What an Unattended Job Needs From a Service25 min
    2. Recorded Responses and the Marker You Move Too Early25 min
    3. Paging Under One Budget That Retries Also Spend30 min
  5. Make It Dependable

    Write down what each run did in a form the next run can read, resume after a partial failure instead of starting again, and notice the job that stopped running at all.

    1. The Run Record, and the One Line Somebody Reads at Eight25 min
    2. Failing Halfway, and Starting From There30 min
    3. Scheduling It, and Noticing When It Stops25 min
  6. Capstone: The Order Digest

    Assemble everything into one scheduled reporting workflow, prove it survives being interrupted and re-run, and package it so somebody who has never seen it can run, schedule, and recover it.

    1. Capstone Part One: Assembling the Digest30 min
    2. Capstone Part Two: Interrupting It On Purpose30 min
    3. Capstone Part Three: Handing It To Somebody Else25 min

learning.goultergroup.com

The interactive parts of this page have not loaded. Reading and links still work; reload the page to try again.