Once you create a project in StreetLight InSight, the project goes through a number of steps before the results are returned to you. This article will explain those steps and what you will experience until you get your results.
The steps that the analyses go through are
- Size Check
- Runtime Estimation
- Coverage and Privacy Check
- Calculation of Metrics
- Creation of Default Export
- Creation of Visualization
Once all the above steps are complete, the project will be marked as "Available" and then you can download and visualize the results.
Note: Occasionally StreetLight InSight will come across a blip during processing. If your project ever goes to "Error" status, please leave the project alone and do not delete it. Also, do not create a new copy of the project as that is also likely to experience the same blip. Please know that Support is notified immediately upon the error happening and is likely looking into the issue as soon as it happens. We will resolve the issue as quickly as possible and reach out to you with status if it will take more than a short while.
Analyses go through a size check to ensure that the configuration will not take an excessive amount of time and resources to process. A project may pass the size check immediately and continue directly to the run-time estimation. A project may fail the size check right after you click "Confirm" when you will have the option to run the Project anyway. Many times there are other ways to configure the project to avoid failing the size check.
If your project fails the size check, upon clicking "Confirm" you will be presented with a dialog explaining the review.
Projects go to size check when:
- They have a Zone Set with a total Zone area that exceeds the recommended maximum of 40000 sq. miles
- They have more than 30 months selected for the data period of a Navigation-GPS project
- They have more than 6 months selected for the data period of a Visitor Home & Work Analysis
Should you choose to continue with the analysis as configured, the project will be created with the status "Under Size Review."
At this time Support is notified of the Project in review. Support will review the project within a business day and will reach out to you to discuss the configuration if we notice an issue. After we have reviewed the Project, the Project will either be passed or flagged. If the project is passed, it will continue on to get its runtime estimation, but not get paused for run-time review, and then go straight to the coverage and privacy check. A flagged project will not continue on.
- Support will communicate with you before flagging a Project.
- The by-pass of the run-time review as described above is available as of our 6.5 release on April 10, 2019. Until then, projects may have been paused by both a size review and a run-time review.
Every project goes through a runtime estimation. The runtime estimator works via a machine-learning algorithm that generates an estimated time to completion for the analysis. This estimation is based on the performance of previously completed projects.
- The result of the runtime estimator is an estimation and not a guarantee of completion time.
- The runtime estimation does not take into account any time that the project may spend waiting in the queue. The estimation is based on when the Project starts processing.
- Projects that are estimated over four hours can take anywhere from hours to a few days. This is our highest time estimation.
If the analysis is estimated to take less than four hours or was passed out of size review by Support, the project will continue to the coverage and privacy checks. If the analysis is estimated to take more than four hours and passed the size check (did not go to size review), the project will be paused for a runtime review.
When a project goes into runtime review, you will receive an email alerting you that the project is listed with the status "Under Runtime Review," and Support is notified. Support will review the project within a business day and will reach out to you to discuss the configuration if needed. A Project in Runtime Review will either be passed or flagged by our Support Team. If the project is passed, it will continue on to the coverage and privacy check. A flagged project will not continue on.
Note: You will be notified by Support prior to your Project being flagged.
Coverage and Privacy Check
Every project goes through a series of checks to ensure there is enough raw data to create meaningful results and that there are no privacy concerns. A project may pass these checks and continue directly to the calculation of the metrics. A project may fail these checks and be paused for review.
Note: An analysis may be paused for the coverage review whether or not it was paused (and passed) for size or runtime review.
The reasons that an analysis may fail these checks:
- Your area Zone is in a rural area or is very small
- You used one or two months of data to run your Project
- You indicated direction on a Zone that did not match up with normal traffic flow
- Your pass-through Zone did not align with the OSM layer
- Your Zone was marked as not a "pass-through" Zone over a pass-through area
- Your Zone did not capture enough trips to give good results.
Note: Often zones that will fail the coverage and privacy checks were marked with a yellow triangle in the Manage Zone Sets tab. This warning often indicates that a Zone will fail the checks. Learn more about the Manage Zone Sets tab.
When a project goes into coverage review, you will receive an email alerting you that the project is listed with the status "Under Coverage Review" and Support is notified. Support will review the project within a business day and might reach out to you to discuss any issues with the Project. Once the Project gets reviewed, the project is either passed or flagged. If the project is passed, it will continue on to the gathering Metrics. A flagged project will not continue on.
Note: You will be notified by Support prior to your Project being flagged.
While the project is "Under Coverage Review," the "Run Covered Zones" action is available for the project. This action allows you to get your results for a subset of the zones while the full project is being reviewed. When you click "Run Covered Zones," StreetLight InSight creates a copy of the zone set and Project configuration, with "Covered" appended to the name, containing only the zones that will pass the coverage and privacy checks. This new project will go directly to the calculation of the Metrics. The project paused for review will remain as such until Support passes or flags the project. If you are satisfied with the "covered" project, please do let Support know.
Note: As of our 6.5 release on April 10, 2019, during the review, Support has the option to flag the Zone Set to by-pass future coverage and privacy checks. Any Zone Set is marked to auto-pass future coverage and privacy checks, will still have the coverage and privacy checks completed, but the results will not cause the project to be paused for review. Zone Sets from projects reviewed before this release are not marked as auto-pass.
Pro-tip: If you are planning multiple analyses with the same Zone Set, complete one full analysis and review the results before creating others. This will ensure that the Zones and configuration are correct before you spend a lot of time creating subsequent projects.
Note: Due to data period variations, a Zone Set that passes the coverage and privacy check the first time it is used (and does not go to review) may not pass the checks in a subsequent project with a different or smaller data period. The Zone Set is only marked to auto-pass review by Support during the coverage review process. You will be emailed if the Support Team auto-passes your zone set.
Calculation of Metrics
Once an analysis has passed all checks and reviews, the project is placed into the processing queue. When there are available resources, the analysis will be processed: the trips of the data sources will be analyzed with the zone and project configuration. When complete, the results will be sent to create the downloads and visualizations.
Note: Our processing queue is a modified "first-in-first-out" list. The fastest way to get your results is to leave your project alone. Cancelling and recreating your project will only move you further down the list and thus make your project take longer. Please know that we are constantly monitoring the processing queue to ensure that everything is flowing through as quickly as possible. If you are concerned about how long your project is taking, please contact us.
Creation of Default Export and Visualization
Once the analyzed results are complete, StreetLight InSight will generate the default export and the visualizations for you to dive into the details. At this time you might see statuses of "Exporting." Once this state is complete, the project will appear as "Available" and the project is available to visualize and download.
Pro-tip: Always choose the defaults in the downloads dialog as this is already generated for you as part of the project processing. The system merely has to deliver the download to you. If you choose a package other than the defaults in the download box, the system will first generate the export and then serve the files to you--taking longer to download.