In the Customer Engagement Console, you can now access useful information about your configured sources, including real-time information during recrawl and reindexing processes.
You can access this information directly from the Sources details page, by clicking the analytics icon located next to the Publish button. You can also access the information from the Analytics section of the CEC, under Sources Overview.
The information reported includes crawling errors, URLs visited and items indexed, providing much needed insights to help you optimise your crawler configuration.