Skip to content

head

in a neural network, a head is the last task-specific part of a model

shared hidden representation -> head -> specific output

object hidden vector
   β”œβ”€ class head β†’ "car"
   β”œβ”€ box head   β†’ [x, y, w, h]
   └─ depth head β†’ 12.4 meters

often just a small linear layer or a tiny separate neural network to convert