{"id":2469,"date":"2019-07-02T09:10:10","date_gmt":"2019-07-02T13:10:10","guid":{"rendered":"https:\/\/www.gsqi.com\/marketing-blog\/?p=2469"},"modified":"2021-01-06T11:11:00","modified_gmt":"2021-01-06T15:11:00","slug":"google-core-ranking-updates-user-studies","status":"publish","type":"post","link":"https:\/\/www.gsqi.com\/marketing-blog\/google-core-ranking-updates-user-studies\/","title":{"rendered":"Google\u2019s Core Algorithm Updates and The Power of User Studies: How Real Feedback From Real People Can Help Site Owners Surface Website Quality Problems (And More)"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-seo.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Google just rolled out another broad core algorithm update <a href=\"https:\/\/www.seroundtable.com\/google-june-2019-core-update-27663.html\">on June 3<\/a> (which was preannounced by Google\u2019s Danny Sullivan.) And once again, the core ranking update was big. It wasn\u2019t long before you could see significant impact from the update across sites, categories, and countries. Some sites surged, while others dropped off a cliff. And that\u2019s par for the course with Google&#8217;s core updates.<br> <br>For example, here are three examples of drops from the June 2019 Google Core Update:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-june-update.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-june-update-b.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-june-update-c.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<p>But I\u2019m not here to <em>specifically <\/em>cover the June update. Instead, I\u2019m here to cover an extremely important topic related to all broad core ranking updates \u2013 conducting user studies. It\u2019s something I have mentioned in a number of my posts about major algorithm updates, and Googlers have mentioned it too by the way. More on that soon.<br><br>My post today will cover the power of user studies as they relate to core ranking updates, and provide feedback from an actual user study I just conducted for a site impacted by several major updates. By the end of the post, I think you\u2019ll understand the value of a user study, and especially how it ties to Google\u2019s core updates by gaining feedback from real people in your target audience. \u00a0<br><br><strong>Google: Take A Step Back And Get Real Feedback From Real People:<br><\/strong>After broad core updates roll out, like the <a href=\"https:\/\/www.gsqi.com\/marketing-blog\/december-2020-google-core-algorithm-update-part-one\/\">December 2020 core update<\/a> or <a href=\"https:\/\/www.gsqi.com\/marketing-blog\/may-2020-google-core-update-case-studies\/\">May 2020 core update<\/a>, Google&#8217;s John Mueller is typically pummeled with questions about how to recover, which factors should be addressed to turn things around, etc. And as I\u2019ve <a href=\"https:\/\/www.gsqi.com\/marketing-blog\/march-12-2019-google-core-algorithm-update\/\">documented<\/a> many times in <a href=\"https:\/\/www.gsqi.com\/marketing-blog\/september-27-2018-google-algorithm-update\/\">my posts<\/a> about <a href=\"https:\/\/www.gsqi.com\/marketing-blog\/august-1-google-algorithm-update-analysis-and-findings\/\">core updates<\/a>, there\u2019s never one smoking gun for sites negatively impacted. Instead, there\u2019s typically a battery of smoking guns. John has explained this point many times over the years and it\u2019s incredibly important to understand. <br><br>But beyond just taking a step back and surfacing all potential quality problems, John has explained another important point. He has explained that site owners should gain <strong>objective feedback from real users<\/strong>. And I\u2019m not referring to your spouse, children, coworkers, top customers, etc. I\u2019m talking about feedback from objective third parties. i.e. People that don\u2019t know your site, business, or you before visiting the site. <br><br>When you conduct a study like that, you can learn amazing things. Sure, some of the feedback will not make you happy and will be hard to take\u2026 but that\u2019s the point. Figure out what real people think of your site, the user experience, the ad situation, the content, the writers, etc. and then form a plan of attack for improving the site. It\u2019s tough love for SEO.<br><br>Here is one video of John explaining that site owners should gain feedback from objective third-parties (at 13:46 in the video). Note, it&#8217;s one of several where John explains this:<\/p>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/u7JY_Tz2c4U?start=826\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\"><\/iframe>\n\n\n\n<p><strong>Conducting User Studies Through The Lens Of Google\u2019s Core Updates:<br><\/strong>When you decide to conduct a user study in order to truly understand how real people feel about a site, it\u2019s important to cover your bases. But it can be a daunting task to sit back and try to craft questions and tasks for people that will capture how they feel about a number of core site aspects. As I explained above, you want to learn how people <em>really <\/em>feel about your content-quality, the writers, the user experience, the advertising situation, trust-levels with the site, and more. So, crafting the right questions is important.<br><br>But where do you even begin??<br><br>Well, what if Google itself actually crafted some questions for you? Wouldn\u2019t that make the first user study a lot easier? Well, they have created a list of questions\u2026 23 of them to be exact. And they did that in 2011 when medieval Panda roamed the web.<br><br>The list of questions crafted by Amit Singhal in the blog post titled <a href=\"https:\/\/webmasters.googleblog.com\/2011\/05\/more-guidance-on-building-high-quality.html\">More guidance on building high-quality sites<\/a> provides a great foundation for your first user study related to Google\u2019s core algorithm updates. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-panda-questions.jpg\" alt=\"\"\/><figcaption>Google&#8217;s blog post from 2011 containing 23 Panda questions.<\/figcaption><\/figure>\n\n\n\n<p>For example, the questions include:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Would you trust the information presented in this article?<\/li><li>Is this article written by an expert or enthusiast who knows the topic well, or is it more shallow in nature?<\/li><li>Would you be comfortable giving your credit card information to this site?<\/li><li>Does the article provide original content or information, original reporting, original research, or original analysis?<\/li><li>Does the page provide substantial value when compared to other pages in the search results?<\/li><li>How much quality control is done on content?<\/li><li><em>And more\u2026<\/em><\/li><\/ul>\n\n\n\n<p>As you can see, these are incredibly important questions to review. The questions can absolutely help you better understand how real users are experiencing your site, how they feel about your site, and ultimately, the questions can help craft a remediation plan covering what you need to change or improve on your own site. <br><br>I have used these questions (or variations of them) to run both quick and dirty user studies, and formal studies. The feedback you can receive is absolutely gold. Not just gold, but SEO gold in the age of broad core ranking updates. <br><br>Let\u2019s face it, this is exactly the type of information that Google is trying to evaluate algorithmically. So, although it\u2019s not easy to run user studies, and it can be time-consuming and tedious, it\u2019s one of the most important things you can do as a site owner. <br><br><strong>Beyond The 23 Panda Questions, More Ideas From The Quality Rater Guidelines (QRG)<br><\/strong>The Panda questions provide a great foundation, but you can absolutely run more user testing using <a href=\"https:\/\/static.googleusercontent.com\/media\/guidelines.raterhub.com\/en\/\/searchqualityevaluatorguidelines.pdf\">Google&#8217;s Quality Rater Guidelines<\/a> (QRG) as your foundation. And there are a boatload of topics, ideas, and questions sitting in the 166-page guide that Google uses with its own quality raters.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-qrg.jpg\" alt=\"\"\/><figcaption>Google&#8217;s Quality Rater Guidelines (as of May 2019)<\/figcaption><\/figure>\n\n\n\n<p>I won\u2019t spend too much time on the QRG in this post, but\nsome topics you might test include:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Page quality.<\/li><li>Needs-met ratings.<\/li><li>Usability.<\/li><li>Monetization and Advertising.<\/li><li>Authors, writers, review boards.<\/li><li>Site reputation.<\/li><li>E-A-T.<\/li><li>User intent.<\/li><li><em>And more\u2026<\/em><\/li><\/ul>\n\n\n\n<p>Now, you can just trust me (and John) and think that user testing is important, or you might want more information. For example, like seeing examples of what you can really learn from a user study. Well, I\u2019ve got you covered. I just conducted a user study for a site that was heavily impacted by the March core update (and that has seen major volatility during several core updates over the years). The feedback we received from the user study was awesome and I\u2019m going to share <em>some<\/em> of it with you (without revealing the site). I think you\u2019ll get the power of user studies pretty quickly. <br><br><strong>User Testing Results: What You Can Learn From Real People: Health\/Medical Case Study<\/strong><br>Again, the site has seen big swings (up and down) during various core updates and I\u2019ve been helping them identify all potential quality problems across the site (including content-quality, technical SEO, user experience, advertising situation, site reputation, UX barriers, and more). <br><br>After fully auditing the site, I used the Panda questions mentioned earlier as the foundation for the user study and tailored some of those questions for the niche and site. Below, I\u2019ll provide some of things we learned that I thought were extremely important for my client to understand. Remember, this is <strong>real feedback from real people<\/strong>.<br><br>Test-wise, I not only used multiple choice questions, but I also used open-ended questions to learn more about how each user felt about certain situations. In addition, I used a platform that provides session recordings of each user going through the study. For this study I used usertesting.com and I\u2019ll explain more about testing platforms later in this post.<br><br>I can tell you that watching and listening to people experience a site is absolutely fascinating. There is so much you can learn from hearing the reaction of users, picking up things they say, and watching how they navigate a site or page. <br><br>So, the combination of quantitative feedback, qualitative feedback, and viewing recorded sessions provides the ultimate recipe for surfacing potential problems on a site. And that feedback can directly help site owners craft a remediation plan that goes beyond fixing minor issues. Instead, you can start to address deeper issues and problems. And that\u2019s exactly what Google\u2019s core updates are about&#8230; Google is evaluating a site overall and not just looking at one or two factors. Remember, there\u2019s never one smoking gun.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-feedback.jpg\" alt=\"\"\/><figcaption>The combination of quantitative and qualitative feedback, <br>plus recorded user sessions = SEO Gold.<\/figcaption><\/figure>\n\n\n\n<p><strong>First, some quick background information about the user study:<br><\/strong>By the time I was setting up the test, I had already fully analyzed the site and provided many areas for improvement. But, we wanted to gain feedback from real users in the site\u2019s target audience about a number of important topics. Also, I wanted to use the 23 Panda questions as a foundation for the test.<br><br><strong>Audience Selection:<br><\/strong>Since usertesting.com has a panel of over one million people, I was able to select specific demographic information that enabled us to make sure the test participants were part of my client\u2019s target audience. For example, I was able to select gender, age, household income, if they were parents (and how old their children were), job status, web expertise, and more. I\u2019ll cover more about this later. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-demographics-select.jpg\" alt=\"\"\/><figcaption>Selecting an audience is powerful within usertesting.com&#8217;s test creation process.<\/figcaption><\/figure>\n\n\n\n<p>So, what were some things I wanted to learn from the\nparticipants? Here are a few of the things I was interested in:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Did users trust the information provided in several articles I asked them to read?<\/li><li>Did they think the articles were written by experts, or just people heavily interested in a topic? <\/li><li>Was the content original? Or did they think it could easily be found elsewhere on the web? <\/li><li>Did they recognize the brand? How about the founders and writers?<\/li><li>How did they feel about recency, original publication dates, if the articles were updated, and how that was treated on the page? <\/li><li>I asked them to review and provide feedback about the background and experience of the site owners, authors, and the medical review board. <\/li><li>I wanted to know if the participants thought there was an aggressive, disruptive, or deceptive advertising situation (since this was a problem when I first started analyzing the site).<\/li><li><em>And more\u2026 <\/em>there were 39 different questions and tasks I had the participants go through.<\/li><\/ul>\n\n\n\n<p>Below, I\u2019ll cover some pieces of feedback that we thought were extremely helpful. By the way, some of the responses (and video clips) were eye-opening. I\u2019ll provide the details below.<br> <br><strong>Examples of feedback from the user study (in no specific order):<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Balance<\/strong> &#8211; Several participants mentioned the importance of balance in the article. For example, thoroughly covering the benefits AND risks of certain topics. Again, this is something that can be very important in articles, especially YMYL articles. <\/li><li><strong>Triggers<\/strong> \u2013 I learned that certain words were triggers for some people, which I could only hear in the video clips. I would have never known that from multiple choice questions. For example, when certain words were read aloud, some participants would react in a way that clearly showed how they felt about that topic. They even said, \u201cwhenever I read {enter word here}, that immediately throws up a red flag for me\u201d. Wow, amazing feedback for the site owners.<\/li><li><strong>Sources and Credibility<\/strong> &#8211; Along the same lines, the sources and citations were extremely important for some of the participants. Some explained that if they see Wikipedia as a source, they immediately become skeptical. One even said it discredits the article. For example, one user said, \u201cwait, so it\u2019s reviewed by a doctor, but it cites Wikipedia\u2026 not sure I trust this article at all.\u201d<\/li><li><strong>Trust &amp; Reactions<\/strong> &#8211; When asked about if a certain participant trusted one of the articles, she laughed out loud. Again, hearing people in the video is incredibly powerful. And laughing is typically not a good thing for a YMYL site. :)<\/li><li><strong>Publish Dates<\/strong> &#8211; There were several important pieces of feedback regarding publish dates, updated dates, etc. First, some assumed that if there was an updated date on the article, then that meant the <strong>entire article<\/strong> had been fully reviewed again. That can be deceptive, since the articles just had specific pieces updated. <\/li><li><strong>More About Publish Dates<\/strong> &#8211; Some participants absolutely wanted to see the original publish date and the updated date. They did not just want the updated date, since that makes them search for clues about when the article was originally published. Some participants explained the process they go through to find the original publish date, which included checking the sources being cited (and the dates associated with those sources). And then they use a savvy approach of checking the comments for dates. <\/li><li><strong>Social Proof<\/strong> \u2013 I heard one participant explain how if she sees a lot of comments, then that means it must be a popular website. Very interesting\u2026 Comments are tough for many sites due to the onslaught of spam, the time involved in moderating comments, etc., but they do seem important for some people. <\/li><li><strong>Author Expertise<\/strong> &#8211; Several participants wanted to know the background of the writers as they were reading each article. Since the articles they were reading covered health topics, they immediately went into \u201cskeptical mode\u201d. This was important to see and underscores the importance of having experts write the content. <\/li><li><strong>Citing Sources<\/strong> &#8211; Several participants explained that just a link to a source wasn\u2019t enough for some articles. They wanted to see stats and facts backing up some claims (in the article itself). For example, maybe providing some of the data directly in the article versus just linking out to another article. <\/li><li><strong>\u201cJust A Blog\u2026\u201d<\/strong> &#8211; I heard several remarks comparing blogs to medical websites. For the health niche, this was very interesting feedback. There was a negative stigma with blogs for some users, especially for health\/medical topics. <\/li><li><strong>Advertising Situation<\/strong> &#8211; Advertising-wise, there were also some interesting pieces of feedback. Remember, there was an aggressive advertising situation when I first started helping the client, so I was extremely interested in hearing what the participants thought of the current ad situation (which has improved, but the site owners haven\u2019t moved as far as I would like them to). I heard one user literally counting the number of ads as she scrolled down the page. 1, 2, 3, wait more, 4, 5. But in a strange twist, she then said the ad situation was fine\u2026 She knew there were a number of ads, but didn\u2019t find them distracting. It&#8217;s extremely important to make sure the advertising situation is ok, since <a href=\"https:\/\/twitter.com\/glenngabe\/status\/1139504100977119235\">Google has explained<\/a> that aggressive ads can impact a site algorithmically over time.  <\/li><li><strong>Affiliate Marketing<\/strong> &#8211; Regarding affiliate links, I did hear, \u201cAre they just trying to sell me something?? Ok, they probably are\u2026\u201d This is something I have brought up to my client during the audit and it\u2019s a tough conversation to have. But remember, Google has explained that there\u2019s a fine balance when delving into affiliate links or affiliate marketing in general. There must be a lot of value added versus monetization. If the scale tips in the wrong direction, bad things can happen Google-wise. So this piece of feedback was extremely important to see\/hear directly from users. <\/li><li><strong>Author Expertise<\/strong> &#8211; When asked about the expertise of the author of an article, the user started scrolling to find the author information and then said, \u201cWait, it\u2019s a blog\u2026 no, I don\u2019t trust the author at all.\u201d I heard this type of comment several times during the user study. More about building a brand and credibility soon.<\/li><li><strong>Content-Quality<\/strong> &#8211; When asked about original content across the articles, almost all of the users in the study said there was some original content, but some of it could easily be found in other places across the web. Not one person said the content was original. This underscores the importance of tackling subject matter where you can provide original content, ideas, perspectives, etc. If you write about what many others are writing about, the content can be viewed as quasi-original. That\u2019s not good enough for a tough niche. &nbsp;<\/li><li><strong>Content Value &#8211;<\/strong> When asked about substantial value from the content compared to other articles on the topic, every one of the users said it was average compared to the others. You clearly don\u2019t want to strive for \u201caverage\u201d. You want 10X content. This was great for my client to see. They have strong articles overall, but users saw them as average compared to the competition. <\/li><li><strong>Side note: SERP UX<\/strong> \u2013 When watching users go to Google and look for a competing article, it was fascinating to see several scroll right by the featured snippet and select something a little farther down the page (in the standard organic results). Sure, this isn\u2019t a large sample size, but just an interesting side note.<\/li><li><strong>Site Design<\/strong> \u2013 When researching other articles on a topic, a user commented that all the sites look the same. And those sites ranged from some of the top health sites on the web to academic sites to health blogs. Site design, branding, etc. comes into play here and it\u2019s something that I don\u2019t think many focus on enough. <\/li><li><strong>Brand Recognition<\/strong> &#8211; Regarding brand, every one of the users in the study said they never heard of the site, brand, etc. This is clearly a signal that the site owners need to work on branding. For example, getting the brand out there more via PR, reaching eyeballs beyond their core audience, etc. <\/li><li><strong>Recency<\/strong> &#8211; For health topics, I heard a user explain they definitely want to see more recent articles on a topic. The article they were reading was a few years old and that didn\u2019t seem sufficient for her. Recency seemed important (but it must <strong>actually <\/strong>be recent and not just an \u201cupdated on XX\u201d tag slapped on the page).<\/li><li><strong>Affiliate marketing<\/strong> &#8211; More comments about \u201cthey are advertising {enter product here}\u201d while reading an article. So yes, users pick up on affiliate links. Again, the value from the article must outweigh the monetization piece.<\/li><li><strong>Citing sources<\/strong> \u2013 There were positive comments about certain sources that were cited, like consumer reports, a scientific study, etc. For health articles, I saw users in the video checking the sources at the bottom of the page, which could help build credibility. <\/li><li><strong>Medical review board<\/strong> \u2013 Overall, the users liked that articles were reviewed by a medical review board. I heard this several times while reviewing the recorded sessions of participants reading the articles.<\/li><li><strong>Expertise and Credibility<\/strong> &#8211; When asked about the expertise and background of the site owners, authors, and medical review board, there were plenty of interesting comments. For example, having a medical review board with various types of doctors, nutritionists, etc. seemed to impress the participants. But I did hear feedback about wanting to see those credentials as quickly as possible on the page. In other words, don\u2019t waste someone\u2019s time. Don\u2019t be too cute. Just provide the most helpful information that builds credibility as quickly as possible. <\/li><li><strong>Awards and Accolades<\/strong> &#8211; For various awards won, users want a link to see more information about that (or they wanted to see more on the page itself). It\u2019s clearly not good enough in this day and age to simply say you won something. Let\u2019s face it\u2026 anyone can say that. They want proof.<\/li><li><strong>Trust <\/strong>&#8211; When asked if they would be comfortable giving their credit card information to the site, most responded, \u201cI\u2019m not sure I would go that far\u2026\u201d or \u201cNo, definitely not\u201d. So, there were clearly some breakdowns with trust and credibility. I saw this throughout various responses in the study. My client has some work to do on that front.<\/li><li><strong>UX barriers<\/strong> \u2013 I noticed errors pop up twice while reviewing the video clips of users going through the site. If these are legit errors, then that\u2019s extremely helpful and important to see. I passed the screenshots along to my client so their dev team could dig in. It\u2019s just a secondary benefit of user testing (with video recordings of each session).<\/li><li><em>And there were many more findings\u2026 <\/em><\/li><\/ul>\n\n\n\n<p>As you can see, between reading their responses, hearing their reactions, and then watching each video session, we gained a ton of amazing feedback from the user study. Some of the feedback was immediately actionable, while other pieces of feedback will take time to address. But overall, this was an incredible process for my client to go through. <br> <br><strong>User Testing Platforms \u2013 Features &amp; User Panel<br><\/strong>If you just read the sample of findings above and are excited to conduct your own user study, you might be wondering where to start. Well, there are several important things to consider when preparing to launch a user study. The first is about the platform you will use.<br> <br><a href=\"https:\/\/www.usertesting.com\/\">Usertesting.com<\/a> is probably the most well-known platform for conducting user studies and it\u2019s the one I used for this test. I was extremely impressed with the platform. The functionality is killer and their panel of over one million people is outstanding. <br><br>In addition, participants sign a non-disclosure agreement (NDA), which can help reduce the chance of your test getting shared publicly. Some sites wouldn\u2019t care about this, but others would care. For example, I know a number of my clients would NOT want the world knowing they are running a user study focused on trust, quality, advertising situation, etc.<br> <br>Audience-wise, I was able to select a range of criteria for building our target audience for the user study (as covered earlier). This enabled me to have participants that were closely tied to my client\u2019s target audience. It\u2019s not perfect, but can really help focus your audience. <br><br>Functionality-wise, you can easily create multiple choice questions, open-ended questions, etc. You can also use Balanced Flow to send users through two different test flows. This can enable you to test different paths through a site or different customer experiences. <\/p>\n\n\n\n<p><strong>Here are some screenshots from the test creation process:<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-test-type-sm.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-setup-type.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-test-plan-sm.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.gsqi.com\/images\/user-testing-video.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Pricing-wise, usertesting.com isn\u2019t cheap\u2026 but could be well worth the money for companies that want to perform a number of user tests (across a range of actions). Remember, the sky\u2019s the limit with what you can test. For example, site design, usability, features, content-quality, site trust, and more. I was ultra-impressed with usertesting.com.<br> <br>Beyond usertesting.com, I also looked into <a href=\"https:\/\/usabilityhub.com\/\">UsabilityHub<\/a> (Google is a client of theirs btw) and <a href=\"https:\/\/www.userlytics.com\/\">userlytics<\/a>. I have not used these other platforms, but they could be worth looking into since they also have large panels of users and what seems to be strong features. <br> <br><strong>Closing Tips and Recommendations:<br><\/strong>Before ending this post, I wanted to provide some closing tips and recommendations when setting up your first test. I am by no means an expert on user testing, but I have learned some important lessons while crafting tests: <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>First, user testing is <strong>not<\/strong> easy. It can be time-consuming and tedious (especially when analyzing the results). Build in enough time to craft your questions and flow, and then enough time for fully analyzing the results. You might be surprised how much time it takes to get it right.<\/li><li>For Google\u2019s core updates, you can definitely use the <a href=\"https:\/\/webmasters.googleblog.com\/2011\/05\/more-guidance-on-building-high-quality.html\">23 Panda questions<\/a> as a foundation for your test. You also might take a subset of those questions and then tailor them for a specific niche and site. After that, you can use the <a href=\"https:\/\/static.googleusercontent.com\/media\/guidelines.raterhub.com\/en\/\/searchqualityevaluatorguidelines.pdf\">Quality Rater Guidelines<\/a> as a foundation for additional tests.  <\/li><li>Try to not ask leading questions. It\u2019s very hard to avoid this\u2026 but don\u2019t sway the results by leading someone down a certain response path.<\/li><li>Session recordings are killer. Make sure you watch each video very carefully. I\u2019ve found you can pick up some interesting and important things while watching and listening to users that are trying to accomplish a task (or just while they are reviewing a site). <\/li><li>Take a lot of notes\u2026 I had a text editor up and running so I could timestamp important points in the videos. Then it was easy to go back to those clips later on while compiling my results.<\/li><li>Try to gain both quantitative and qualitative feedback from users. Sure, multiple choice questions are great and can be quick and easy, but open-ended questions can yield important findings that might not be top-of-mind when crafting your test. And then layer on videos of each session, and you can gain a solid view of how real users view your site, content, and writers.<\/li><li>Find the right balance for the number of participants. Usertesting.com recommends up to 15 participants for a test. Don\u2019t overload your test, which can lead to data overkill. Try different numbers of participants over a series of tests to see what yields the most valuable results. For some tests, 5 participants might be enough, while other tests might require 15 (or more). &nbsp;<\/li><\/ul>\n\n\n\n<p><strong>Summary \u2013 User testing can be a powerful tool for sites impacted by Google\u2019s core ranking updates<\/strong><br>Google has explained many times that it is looking at many factors when it comes to broad core ranking updates. That includes content-quality, technical SEO, user experience (UX), advertising situation, E-A-T, and more. Google\u2019s John Mueller has also explained that it\u2019s important to take a step back and <strong>objectively <\/strong>analyze your site. <br> <br>Well, a great way to objectively analyze your site is by conducting user testing. Then you can have objective third-parties go through your site, content, features, etc., and provide real feedback. I\u2019ve found this process to be extremely valuable when helping companies impacted by major algorithm updates since it can surface qualitative feedback that is hard to receive via other means. I recommend trying this out for your own site (even if you haven\u2019t been impacted by core updates). I think you\u2019ll dig the results. Good luck.<br> <br>GG<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google just rolled out another broad core algorithm update on June 3 (which was preannounced by Google\u2019s Danny Sullivan.) And once again, the core ranking update was big. It wasn\u2019t long before you could see significant impact from the update across sites, categories, and countries. Some sites surged, while others dropped off a cliff. And &#8230; <a title=\"Google\u2019s Core Algorithm Updates and The Power of User Studies: How Real Feedback From Real People Can Help Site Owners Surface Website Quality Problems (And More)\" class=\"read-more\" href=\"https:\/\/www.gsqi.com\/marketing-blog\/google-core-ranking-updates-user-studies\/\" aria-label=\"Read more about Google\u2019s Core Algorithm Updates and The Power of User Studies: How Real Feedback From Real People Can Help Site Owners Surface Website Quality Problems (And More)\">Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[24,4,3,5],"tags":[],"class_list":["post-2469","post","type-post","status-publish","format-standard","hentry","category-algorithm-updates","category-google","category-seo","category-tools","generate-columns","tablet-grid-50","mobile-grid-100","grid-parent","grid-50"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/posts\/2469","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/comments?post=2469"}],"version-history":[{"count":15,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/posts\/2469\/revisions"}],"predecessor-version":[{"id":2922,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/posts\/2469\/revisions\/2922"}],"wp:attachment":[{"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/media?parent=2469"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/categories?post=2469"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.gsqi.com\/marketing-blog\/wp-json\/wp\/v2\/tags?post=2469"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}