How can I create a Category Index page that lists all categories?

1 – Create a custom template file in your theme e.g "my-custom-template.php"

2 – Create a page from the dashboard, and in the page attributes box(Right sidebar), select the custom template you’ve juste created as a Model.

3 – use wp_list_categories to get the list of your available categories…

hope this helps you out.