Pooling and segmenting motion signals