c depth rate. Default: 0.0 ls_init_value (float): Init value for Layer Scale. Default: 1e-6. r