Created by: punitkoura
Upstream sequence parallelism changes to main branch. (See #537) for details on the change