Stock Photo Secrets Shop Offline (New Update)
UPDATE – We are back online!
Please visit: https://shop.stockphotosecrets.com/
Dear Stock Photo Secrets Shop Clients,
we still experience networking issues in our datacenter but our IT department is working hard to fix it. The team has worked through the night to fix the problem. Unfortunately it is a very complex cloudsoftware/networking issue which not easy to fix. We want to be fully transparent here and give you a insight into the problem. Please read ahead!
UPDATE – 30th August: Technical Explanation of Downtime
In a normal case of hardware failure we have a contingency plan. All databases are backed up and mirrored on separate sites. This addresses the very occasional possibility of a hardware failure of a certain device. In such a (rare) instance we would always be online again within an hour or so. However, in this case we are dealing with an entirely unprecedented software issue, all data is available but the server software cannot access it fully. It is almost impossible to prepare for, or anticipate.
Our team has been working with various external expert teams in the field – so far without success. To give you a better understanding of what is going on, some extra information about the platform: our websites run on a cloud that is built from 7 vast servers. Those servers connect to 4 storages for all their data, the websites themselves, the search engines and the images. Storage 1 and 2 are currently not accessible, storage 3 and 4 are. However, storage 1 holds all databases, the backups of which are on storage 2. We need at least 1 of the 2 back online. Both storages appear to be running and all data is intact. However, when connecting the cloud to the storage, they cannot communicate with one another.
We are working with teams from the manufacturers. Although it seems a software issue, also hardware replacements (of network cards) are considered. There are still lots of options to proceed. I really regret that I have to say this, but we may be facing a situation that is going to take longer. Worst case the storages are taken to the manufacturers so they can get them running in their lab and get the data from it, so we can put it all up on new storages.
I would very much like to give you a good estimate of when all will be resolved, but I cannot with certainty. We aim for today but it may be longer. Again I really cannot apologise enough for the inconvenience that this is undoubtedly likely to cause you.
UPDATE – 30th August Evening (UCT)
The teams seem to have found an entry into the database storages and they will now backup them again. We do not want to risk any data. I will keep you updated on this page.
UPDATE – 30th August Later Evening (UCT)
Finally some good news to report: the team got access to all databases and all is OK! It will take a bit more time to get everything back operational, but with this the biggest step of the whole process is done.
UPDATE – 30th August – Night (UCT): All the database got restored successfully. The team is working on restoring the webservers now and the website data. This can still take some hours and it is NOT assured that the website will be up and running soon. But finally it looks like a good sign that we are back online not later than tomorrow (morning). Keep in mind, that this can not be guaranteed! We’ll keep you up to date.
UPDATE – 31st August – Morning (UCT): Overnight the team didn’t manage to get the last faulty storage accessible. We have been, and still are, in the process of getting the servers online using back-up data. This means that we may be missing some data for the moment, but at least we can get our websites back online. The whole process will take another few hours. But we will have it back up by today (UCT). We keep you posted as soon as there is more news.
I want to assure you that we are doing everything possible to get the environment up and running again. All of our server team is working on the problem for hours day and night.
Obviously for all downtime your subscription will be extended accordingly although we appreciate that this will not, in many cases, fully compensate for the inconvenience.
We still hope that the problems can be resolved shortly, though we cannot give you a valid estimate as the situation at hand is far some standard.
Meanwhile, please accept our sincerest apologies.
We will be posting regular updates on this page.
Do you have a estimate when you are back online?
Please read our technical update about the process above. I would very much like to give you a good estimate of when all will be resolved, but I cannot with certainty. We aim for today but it may be longer. Again I really cannot apologise enough for the the inconvenience that this is undoubtedly likely to cause you. You can be assured that everyone in the team is working hard on getting the servers online as fast as we can. I understand that you have projects to finish, so please accept my apologies for this issue. I will update you here and on the website itself when we are back online.
What is this SSL Error or Connection is not Secure Error?
You can ignore this error message. It only shows that the original servers are still offline and therefore your browser “warns” you to visit our backup-site with the announcement.