ImpalaEvents

class maze.train.trainers.impala.impala_events.ImpalaEvents

Events specific for the impala algorithm, in order to record and analyse it’s behaviour in more detail

estimated_queue_sizes(before: int, after: int)

Record the estimated queue size before and after the collection of the actors output

Parameters:

  • before – the estimated queue size before collection

  • after – the estimated queue size after collection

time_backprob(time: float, percent: float)

Record the total time it took the learner to backprob the loss + relative per to total update time

Parameters:

  • time – the absolute time it took for the computation

  • percent – the relative percentage this computation took w.r.t. to one update

time_collecting_actors(time: float, percent: float)

Record the total time it took the learner to collect the actors output + relative per to total update time

Parameters:

  • time – the absolute time it took for the computation

  • percent – the relative percentage this computation took w.r.t. to one update

time_dequeuing_actors(time: float, percent: float)

Record the time it took to dequeue the actors output from the synced queue + relative per to total update time

Parameters:

  • time – the absolute time it took for the computation

  • percent – the relative percentage this computation took w.r.t. to one update

time_learner_rollout(time: float, percent: float)
Record the total time it took the learner to compute the logits on the agents output

  • relative per to total update time

Parameters:

  • time – the absolute time it took for the computation

  • percent – the relative percentage this computation took w.r.t. to one update

time_loss_computation(time: float, percent: float)

Record the total time it took the learner compute the loss + relative per to total update time

Parameters:

  • time – the absolute time it took for the computation

  • percent – the relative percentage this computation took w.r.t. to one update