I came across a link to a petition on the White House petition site asking that presidential debates include third-party candidates. I became curious, because this is an issue that is a concern to many Americans.
The “Open Government” is Blocking Google Search
The best way to search a website is with Google, so I used the site operator to search for petitions about presidential debates. The results indicated that the website is blocking Google from indexing the petitions:
If you look at the description under the purple link there, it says, “A description for this result is not available because of this site’s robots.txt”, which means that the site is intentionally blocking Google.
The relevant robots.txt rules are:
If you click the link at the bottom to include the omitted results, you can see some of the couple dozen previous petitions about presidential debates. Most of them expired before they got enough votes, which is understandable, because no one can find them.
Here are some of the titles of the petitions, based on their URLs, showing that the issue of open presidential debates is important to people:
The Website’s Search Box Doesn’t Work Well
I then tried to use the website’s search box, but I couldn’t get the right results. When I searched for “presidential debates” I got 12 results, and none of them were the active petitions about presidential debates.
Also, the search feature is not sophisticated enough to know that when I search for “debate” the plural form is also okay. I searched for “debate” and got zero results:
I searched for “debates” and got only one result. It didn’t include the live petitions that are about the presidential debates.
Trying to Browse All Results
I also tried to browse all of the open petitions to find information about presidential debates.
Strangely, there are only only 294 open petitions and there are none listed about presidential debates in that list, because I searched the page with my browser:
However, there actually are at least two open petitions about presidential debates that I was able to find through other means. Here are screenshots:
To be thorough, I also searched the list of “popular petitions” and the posts weren’t there either:
What Is Featured?
I suppose that one could argue that a petition with only a few votes is not worthy of being featured, but I don’t know how it could be argued that they should be unfindable.
As I mentioned at the top of the page, the issue of having fair presidential debates is important to Americans. Yet, a look at the top petitions on the page include this one:
- Remove the robots.txt rules that block Googlebot. If this is “open government”, then let the search engines index the information.
- Implement a better search feature. The current one doesn’t work.
If anyone has any other suggestions, please leave a comment below.