gate = nn.Sequential(nn.Linear(2 * dim, hidden), nn.Tanh(), nn.Linear(hidden, dim), nn.Sigmoid())
Source: unitrack/benchmarks/hota/learned_modules.py:48