You have the working example available in UI gallery. Open Grid in UI Gallery -> Click on "Paging" in the right side navigation menu. In the landed page, click on "Advanced", you will get following grid.
Open the design time configuration of the grid, you will find the pagination activity for the reference.
The OOTB pagination activity your are looking for is "pxAdvancedPaginateForEmployees"
Hope this helps.
Please feel free to reply if you have nay thoughts. Thank you,