Invintus StatusSubscribe to updatesService archive
Published incidents and maintenance from the Invintus operations record.
Resolved · Control Center, Player
All mitigations are in place: page loads and background updates for the Control Center, Channel Listings, and Video Player are working. We do see continued error rates with the third-party's service but are marking this degradation as resolved.Resolved · API, CORE SERVICES, Control Center, Player
systems systems have been back online since shortly after 11AM. We are just currently monitoring the situation to make sure that we do not encounter the same issues.Completed · API, Analytics, CORE SERVICES, Control Center
The maintenance has been completedResolved · Transcode
We've identified the issue within our system and have resolved it. No Live Streams were affected by this service degradation.Resolved · API, Control Center, Player
We believe the degraded performance issue has been resolved. We have posted performance updates to our API instances, improved communication between our API and database, and refined our auto-scaling rules. We will continue to monitor API performance over the coming days to ensure resolution.Resolved · API, Control Center, Player
We've identified the issue and have taken action to ensure all systems are back to functioning nominally.Completed · Analytics, CORE SERVICES, Control Center, Egress US-CENTRAL
Our backend maintenance has concluded and all systems are back online. We will continue to run tests to ensure that all systems are working nominally. In the event we do discover any issues further notices will be sent out to all Clients. Thank you.Completed · API, Analytics, CORE SERVICES, Control Center
Resolved · Egress US-WEST, LIVE CDN
We've Identified the issue and have brought services back online.Resolved · Egress US-CENTRAL, Egress US-EAST, Egress US-WEST
The incident has been resolvedResolved · Player
Our Third Party vendor has identified the issue within their system and have resolved it. All Media Players are back to normal. We will continue to monitor and verify their fix over the next few hours to ensure load times are nominal.Resolved · Control Center
We've been able to rectify the issue and all Realtime updates are now fully functional again.Resolved · Ingress US-West
We've patched the issue and all services are back to normal.Completed · API, Analytics, CORE SERVICES, Control Center
The maintenance has been canceledCompleted · API, CORE SERVICES, Control Center
Resolved · Control Center
We sincerely apologize for any impact by the recent incident with control center. Auth0 (okta) resolved the issue stating that this was due to the major outage in our cloud provider AWS. We did confirm that an AWS outage for internet connectivity for several regions did cause issues. Reliability is our highest priority. We will continue to be transparent with the ongoing actions we are taking to ensure the reliability of our platform. https://status.aws.amazon.com https://status.auth0.comResolved · Transcode
Moved to back up system as we try to resolve the issue.Completed · Analytics
Resolved · Control Center
The issue has been resolvedCompleted · Ingress US-Central, Ingress US-East, Ingress US-West
Resolved · Control Center
Resolved The incident has been resolved. We apologize for the disruption of service. We will provide our providers detailed Root Cause Analysis (RCA) within the next 14 days or when we receive it.Resolved · Player
We Identified the issue and applied a fix to our system which has now propagated to all Users. We'll continue to monitor the issue but consider this resolved.Resolved · API
We found and resolved the issue but are actively monitoring the situation with our providerCompleted · Analytics, Ingress US-West, LIVE CDN
Completed · Platform-wide
Completed · Egress US-WEST
Resolved · Control Center
Our provider has been able to restore service. With the patch we deployed to Control Center we were able to alert users of the loss of certain functionality if this service does go down. However we will be taking steps that will make this part of our service more reliable in the future.Resolved · CORE SERVICES
We have mitigated the issues with our core services that was caused by a short lived DDOS attack.Completed · API, CORE SERVICES, Control Center, Player
Resolved · Player
Our CDN provider has sent us a resolution: "Resolved: We have mitigated the conditions leading to page load failures and have been monitoring the work for the past 15 minutes and our service levels are back to normal. " If you have seen or see any problems occurring after 12:50PM PST let us know and we will circle back to our CDN to report any more issues. Also you can check in at the service availability tab in the service status section of the help in the Invintus Control center.Resolved · CORE SERVICES, Control Center, Transcode, VOD CDN
AWS has posted a resolution notice [RESOLVED] Intermittent DNS Resolution Errors Between 10:30 AM and 6:30 PM PDT, we experienced intermittent errors with resolution of some AWS DNS names. Beginning at 5:16 PM, a very small number of specific DNS names experienced a higher error rate. These issues have been resolved.Resolved · Egress US-EAST
Zones that were affected were removed from service. EGRESS US-EAST is now stable.