Title: domtra's Replies | WordPress.org

---

# domtra

  [  ](https://wordpress.org/support/users/domtra/)

 *   [Profile](https://wordpress.org/support/users/domtra/)
 *   [Topics Started](https://wordpress.org/support/users/domtra/topics/)
 *   [Replies Created](https://wordpress.org/support/users/domtra/replies/)
 *   [Reviews Written](https://wordpress.org/support/users/domtra/reviews/)
 *   [Topics Replied To](https://wordpress.org/support/users/domtra/replied-to/)
 *   [Engagements](https://wordpress.org/support/users/domtra/engagements/)
 *   [Favorites](https://wordpress.org/support/users/domtra/favorites/)

 Search replies:

## Forum Replies Created

Viewing 13 replies - 1 through 13 (of 13 total)

 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Tests keeps getting stuck](https://wordpress.org/support/topic/tests-keeps-getting-stuck/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [1 year, 3 months ago](https://wordpress.org/support/topic/tests-keeps-getting-stuck/#post-18417737)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/) ,
 * this is very strange. Could you please deactivate and delete the plugin again
   and try to reinstall?
 * Do you have a firewall for outgoing connections by any chance or did anything
   else change in your setup?
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Tests keeps getting stuck](https://wordpress.org/support/topic/tests-keeps-getting-stuck/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [1 year, 4 months ago](https://wordpress.org/support/topic/tests-keeps-getting-stuck/#post-18378233)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/),
 * thanks for sending the error message. I think this is more a symptom and not 
   the cause of the issue. But it does help debugging a bit.
 * Unfortunately, we have not found the real cause yet.
 * To clarify, you said that you sometimes make development changes to the site.
   Does this also include restoring backups or something similar? Or is it just 
   about changing code?
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Tests keeps getting stuck](https://wordpress.org/support/topic/tests-keeps-getting-stuck/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [1 year, 5 months ago](https://wordpress.org/support/topic/tests-keeps-getting-stuck/#post-18343334)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/) , for some reason, 
   your project was deactivated again, on March 1st. But it was running successfully
   since January, right? Did you by any change do something special recently? Like
   migrate the site, change something in the database or on the filesystem or something
   similar?
 * Besides that, I could see that the screenshot timed out before. That usually 
   happens when long polling or some other techniques are used so that our script
   does not know that the site finished loading. I checked this manually now but
   all seemed to be working. Did you make any changes to the site since it stopped?
 * We will see if we can add some retry functionality, manual or automatic. But 
   it would be great to get to the bottom of your specific issue first.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] address IP is blocked by CF WAF rules](https://wordpress.org/support/topic/address-ip-is-blocked-by-cf-waf-rules/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [1 year, 6 months ago](https://wordpress.org/support/topic/address-ip-is-blocked-by-cf-waf-rules/#post-18240231)
 * Hi Dariusz,
 * we have added IPv6 to our servers but forgot to add it to the docs. Thanks for
   pointing that out.
 * I have updated the docs now.
 * Thanks again, Dominik.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Tests stopped running two weeks ago](https://wordpress.org/support/topic/tests-stopped-running-two-weeks-ago/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [1 year, 7 months ago](https://wordpress.org/support/topic/tests-stopped-running-two-weeks-ago/#post-18233772)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/) ,
 * this is strange. Your project seems do have been deactivated. Did you by any 
   change deactivate or uninstall the plugin at some point?
 * Could you please try to deactivate the plugin now and activate it again? This
   should restore it. If this does not work, please let me know and I will have 
   a look again.
 * Sorry for the inconvenience.
 * Cheers, Dominik.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] False positive feature issue](https://wordpress.org/support/topic/false-positive-feature-issue/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 1 month ago](https://wordpress.org/support/topic/false-positive-feature-issue/#post-17853628)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/),
 * I looked at your screenshots in our database. The way we save the false positive
   is via a checksum of the diff image. That means not only that the differences
   need to be at exactly the same spot, but also that the rest of the image must
   not differ.
 * At least if you compare the screenshots from 05/29 and 06/16 to 06/19 and 06/
   19, you will see that at the bottom of the screenshot there is a small horizontal
   rule at the beginning of the footer.
 * For the other one, I cannot make out a visual difference but the checksum from
   the comparison is definitely different. I can also see in our DB that there are
   a few comparisons marked as false positives and some alert were filtered out.
   It just also seems that from time to time the checksum changes.
 * So from our side, the feature is working as expected. But we will keep your case
   in mind and see if we, in the future, make some changes to how a false positive
   is identified.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Add delay after using the click selectors](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/#post-17535600)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/),
 * just to let you know, we have implemented a general 2 second delay for all screenshots
   to better deal with some of the loading issues. Currently there are no plans 
   to add an option for additional delays.
 * Let us know if you have additional feedback or questions.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Weird repeating anomaly with test results](https://wordpress.org/support/topic/weird-repeating-anomaly-with-test-results/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/weird-repeating-anomaly-with-test-results/#post-17535586)
 * Hi @asafm7,
 * we have released the false positive feature in version 1.8.0 of the plugin. It
   is already available. Would be great if you could give us some feedback about
   how this works for you.
 * Not generating false negatives was really important for us. This is why we opted
   for a pretty strict definition of false positives. When you have an alert, you
   see the diff of the two images. A mostly transparent image with some red pixels
   in it. We compare these diffs to those diffs that you marked as false positives
   before. So only if the differences between two comparison are exactly the same,
   it will count as a false positive.
 * Hope you understand what I mean.
 * I am going to resolve this thread. Feel free to contact us with further questions
   or feedback.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Weird repeating anomaly with test results](https://wordpress.org/support/topic/weird-repeating-anomaly-with-test-results/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/weird-repeating-anomaly-with-test-results/#post-17481296)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/),
 * This is odd. I did some manual testing and did not have the issue you describe.
 * Could you try to add a click to the consent management popup to see if this changes
   anything? For that, please add `.cmplz-btn.cmplz-accept` to the settings field`
   Click an element before creating a snapshot`.
 * If that does not help, we will continue to tweak the screenshotting service to
   get more consistant results. Additionally, in the next version of the plugin 
   that we will publish soon, you have the ability to mark a comparison / test as
   false positive. So for this exact diff, you can prevent it from becoming an alert.
 * I will update you, once we have released the new version. Until then, I hope 
   my other suggestion can solve this issue.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Add delay after using the click selectors](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 7 months ago](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/#post-17291482)
 * [@asafm7](https://wordpress.org/support/users/asafm7/), it seems that previously
   there were some issue with timeout during the screenshot phase which were not
   resolved properly. This may result in some test being stuck.
 * I tried to get them unstuck for you and it should have worked at least for one
   of your tests. Can you confirm that?
 * If there is still an issue, can you try to disable the test and the undo via 
   the link in the admin notice? After that, the test should be set up properly 
   again.
 * Sorry for the inconvenience.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Multisite compatible?](https://wordpress.org/support/topic/multisite-compatible-217/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 8 months ago](https://wordpress.org/support/topic/multisite-compatible-217/#post-17242118)
 * Hi [@blackdranzer](https://wordpress.org/support/users/blackdranzer/),
 * we have an update for you.
 * We do support multisites now!
 * For new installs it will just work out of the box. If you already have our plugin
   installed and run into issues, you need to delete the plugin and then manually
   delete some tables and options in your database.
 * Depending on your db prefix and the number of sites you have installed, the following
   queries need to be executed. Please be sure to make a database backup, before
   executing the queries.
 *     ```wp-block-code
       DROP TABLE IF EXISTS wp_vrts_tests;
       DROP TABLE IF EXISTS wp_1_vrts_tests;
       DROP TABLE IF EXISTS wp_2_vrts_tests;
       ...
       ```
   
 *     ```wp-block-code
       DROP TABLE IF EXISTS wp_vrts_alerts;
       DROP TABLE IF EXISTS wp_1_vrts_alerts;
       DROP TABLE IF EXISTS wp_2_vrts_alerts;
       ...
       ```
   
 *     ```wp-block-code
       DELETE FROM wp_options WHERE option_name LIKE 'vrts_%;'
       DELETE FROM wp_1_options WHERE option_name LIKE 'vrts_%;'
       DELETE FROM wp_2_options WHERE option_name LIKE 'vrts_%;'
       ...
       ```
   
 * I hope this helps. Let me know if everything works as expected now.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Add delay after using the click selectors](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 8 months ago](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/#post-17242105)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/), and thanks for the
   link.
 * The problem on the site you provided seems to come from Chrome itself. This is
   the browser we use to take screenshots. If you navigate in Chrome to your website
   and take a full page screenshot via the devtools, you will see, that although
   the iframes have been loaded, they will not show up on the screenshot. Chrome
   is somehow hiding them, when they are not in the viewport and fading them in,
   once they are.
 * Firefox, for example, behaves differently.
 * I have found a solution to this. But the technique might introduce issues in 
   other situations. I will need to do some more tests and we nee to further evaluate
   if our current approach leads in general to better results, or the new one we
   came up with.
 * I will keep you posted about the progress. And sorry for your inconvenience.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[VRTs - Visual Regression Tests] Add delay after using the click selectors](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/)
 *  Plugin Support [domtra](https://wordpress.org/support/users/domtra/)
 * (@domtra)
 * [2 years, 8 months ago](https://wordpress.org/support/topic/add-delay-after-using-the-click-selectors/#post-17210107)
 * Hi [@asafm7](https://wordpress.org/support/users/asafm7/),
 * thanks for your feedback.
 * There is currently no manual delay you can add while taking a screenshot. We 
   have a lot of checks in our code that wait for the page to be finished load and
   the network being in idle.
 * There are some edge cases when this does not work.
 * If you can give me the URL of the website where you experience these issues, 
   I might be able to have a look and find a solution to solve this.
 * Best, Dominik.

Viewing 13 replies - 1 through 13 (of 13 total)