htmlbasictutor.ca

Search engines work in three separate stages: discovery, crawling/indexing, and ranking. A page can fail at any one of them, and each failure has a different fix. If your page isn't showing up, the fastest path is to check the stages in order — don't jump straight to "ranking factors" before you've confirmed the page is even indexed.

This guide walks through each stage, what blocks it, and a step-by-step diagnostic sequence you can run with free tools.

Stage 1: Discovery — How Search Engines Find Your URLs

Before a search engine can crawl a page, it has to know the URL exists. There are four main discovery paths:

• Links from other sites (external backlinks)
• Internal links from pages already known to the search engine
• XML sitemaps you submit
• Redirects and canonical signals pointing to the URL

What blocks discovery

• Orphan pages: no internal links point to them, and no sitemap includes them. These are effectively invisible.
• Sitemap errors: a sitemap that lists non-canonical URLs, returns errors, or isn't referenced in robots.txt.
• Noindex on linked pages: if the only page linking to your target is itself excluded, the crawler may never follow the path.

Practical fix

1. Add at least one contextual internal link from a page that is already indexed.
2. Confirm the URL appears in your XML sitemap and that the sitemap is submitted.
3. Check robots.txt doesn't disallow the path.

Stage 2: Crawling and Indexing — Getting the Page Stored

Crawling means the bot fetches the page. Indexing means the content is stored and eligible to appear in results. These are not the same thing — a page can be crawled but not indexed.

Common crawl blockers

Common indexing blockers (page is crawled but not stored)

• Thin or duplicate content: near-identical to another URL on your site.
• Canonical tag pointing elsewhere: you're telling the engine "index that page instead."
• Soft 404: page returns 200 but looks empty or error-like.
• Wrong canonical chosen by the engine: often caused by conflicting signals (sitemap says A, canonical says B).

How to check index status

Use a site: query in the search engine (for example, site:example.com/page) as a rough check. It's not exact, but it tells you whether the URL is in the index at all. For a more structured view, use the search engine's own webmaster console if you have one — that's the authoritative source for coverage status.

Stage 3: Ranking — Why an Indexed Page Still Doesn't Appear

Once a page is indexed, ranking depends on relevance and authority signals. The main on-page levers:

Title and headings

• The title tag is still one of the strongest relevance signals. Put the primary topic near the front.
• H1 and subheadings should reflect what the page actually covers, not keyword-stuffed variants.
• Mismatch between title and body content is a common reason a page ranks for nothing.

Content depth and intent match

• Does the page answer the question the searcher is asking? A page about "search engines" that only defines the term will lose to a page that explains crawling, indexing, and ranking.
• Cover the subtopics a searcher would expect. Thin coverage on a broad topic rarely ranks.

Internal links and authority

• Internal links pass context and relative importance. A page with no internal links is treated as low priority.
• External backlinks still matter, but quality and relevance outweigh raw count.

Technical signals

• Mobile rendering: if the mobile version hides content, rankings suffer.
• Core Web Vitals: page experience is a tiebreaker, not a primary driver, but poor performance can hurt.
• HTTPS and clean URL structure: baseline expectations.

A Step-by-Step Diagnostic Sequence

Run these in order. Stop when you find the failure point.

1. Is the URL in the index? Run site:yourdomain.com/page. If nothing appears, go to step 2. If it appears, skip to step 5.
2. Is it blocked by robots? Check robots.txt for a Disallow rule matching the path. Check the page's meta robots and HTTP X-Robots-Tag.
3. Is it discoverable? Confirm the URL is in your sitemap and has at least one internal link from an indexed page.
4. Is it canonicalized elsewhere? Check the rel="canonical" tag. If it points to a different URL, that URL is the one being indexed.
5. Is it indexed but not ranking? Compare your title and H1 against the query. Check whether the page covers the subtopics the top results cover.
6. Check backlinks and keyword position. Free tools like the ones on SmallSEOTools.com can give you a backlink overview and keyword position tracking. Treat these as directional signals, not precise measurements — free backlink and rank tools typically sample data and can differ from what a search engine's own console reports.

Common Misconceptions

"Submit the URL and it indexes instantly." Submission queues a crawl; it doesn't guarantee indexing or timing. Indexing can take hours to weeks depending on the site.

"Meta keywords help ranking." They've been ignored by major search engines for years. Don't spend time on them.

"I can guarantee a #1 ranking." No tool or service can guarantee a specific position. Rankings depend on competition, query, location, and personalization. Anyone promising a fixed position is overstating what's controllable.

"More backlinks always means better rankings." Low-quality or irrelevant links can be ignored or actively harmful. Relevance and trust matter more than volume.

"If it's indexed, it should rank." Indexing is eligibility, not promotion. A page can be indexed and still rank on page 10 because it's less relevant or less authoritative than competitors.

Quick Reference: Which Stage Is Failing?

Work through the stages in order. Most "my page won't rank" problems turn out to be discovery or indexing problems, and those are usually the fastest to fix.

Free SEO tools can handle a surprising amount of real work: checking backlinks, auditing on-page elements, tracking keyword positions, and generating reports. For a small site or a beginner, they cover most day-to-day tasks. The catch is not capability but capacity — free tools usually limit how much data you can pull, how often you can pull it, and how precisely you can filter it. Understanding those limits lets you decide what to do for free and when paying becomes the sensible next step.

Mapping Common SEO Tasks to Free Tool Coverage

Most SEO work falls into a handful of recurring jobs. Here is how free tools typically perform on each.

The pattern is consistent: free tools answer "what is roughly true right now" well, and "what exactly changed over time" poorly.

The Practical Limits You Will Hit

Free tools are not crippled versions of paid ones by accident. The limits exist because crawling, storing, and serving link and ranking data is expensive. Expect these constraints:

• Usage caps. A fixed number of queries per day, or a character/word limit on content tools. Once you hit the cap, you wait.
• Sampled data. Backlink checkers often show a subset of links rather than the complete profile. Two tools can report very different totals for the same site, and both can be "correct" within their own index.
• Delayed or cached results. Ranking positions and link counts may be days or weeks old. Nothing free is truly real-time at scale.
• Fewer export and filtering options. You may see results on screen but not be able to download them, sort by multiple columns, or filter out low-quality links.
• No saved history. Without stored snapshots, you cannot see whether a metric improved or declined over the past month.

None of this makes free tools useless. It means you should treat their output as a directional signal, not a precise measurement.

How to Read Backlink Counts and Authority Scores

Two numbers cause the most confusion: backlink count and domain authority-style scores.

Backlink counts vary by index. If one tool says 400 links and another says 1,200, the difference is usually coverage, not error. Use a single tool consistently so your own trend line is comparable, and treat the absolute number as approximate.

Authority scores (often labeled DA, DR, or similar) are third-party estimates, not metrics search engines publish. They compress many signals into one number. That makes them convenient for quick comparison and dangerous as a sole decision criterion. A high score does not guarantee rankings, and a low score does not mean a page cannot rank for a specific query.

A safer habit: look at three things together — referring domains (more meaningful than raw link count), the relevance of linking sites to your topic, and whether your own score is trending up or down over time.

A Simple Free-Tool Workflow for a Small Site

This loop works for a blog, a local business site, or a small store. It assumes you have no budget and limited time.

1. Audit. Run your key pages through an on-page checker. Record the title, meta description, H1, word count, and any missing alt text in a simple spreadsheet.
2. Fix. Correct the obvious issues first: duplicate or missing titles, thin content, broken internal links, slow-loading images. These are the highest-return fixes and cost nothing.
3. Track. Pick 10–20 keywords that matter. Check their positions weekly with a free tracker or manually, and log the date and position.
4. Compare. Once a month, check referring domains and your authority-style score. Note the direction, not the exact figure.
5. Repeat. Re-audit pages that lost positions or gained traffic. Update content rather than adding new pages endlessly.

Keep one spreadsheet with three tabs: pages, keywords, and links. Consistency matters more than tool choice.

When a Task Has Outgrown Free Tools

Consider paying when one of these becomes true:

• You need to track more keywords than the free cap allows, or you need daily updates.
• You must export full backlink lists for outreach or disavow work.
• You are auditing a site with hundreds or thousands of pages and need a complete crawl.
• You need historical data to prove whether a change worked.
• Multiple people need to work in the same tool with shared access.

Until then, free tools plus a disciplined spreadsheet will carry a small site a long way.

Common Pitfalls to Avoid

• Trusting one metric. No single score decides rankings. Combine authority, relevance, and traffic data.
• Expecting real-time rankings. Free trackers lag. Judge trends over weeks, not hours.
• Comparing across tools. Different indexes produce different numbers. Pick one and stay with it.
• Chasing link counts. Ten relevant links from real sites beat a thousand low-quality ones.
• Skipping the fix. Auditing without acting is just collecting data. The value is in the changes you make.

Free SEO tools are genuinely useful for auditing, tracking, and learning. Their limits are about scale and precision, not usefulness. Start with the workflow above, watch your trend lines, and upgrade only when a specific task clearly demands more than the free tier provides.

HTML (HyperText Markup Language) is the markup language that gives a web page its structure and content. It tells a browser what each piece of a page is — a heading, a paragraph, a link, an image — rather than how it should look. If you want to understand how any website is built, HTML is the starting point: it's the skeleton that CSS styles and JavaScript animates. This explainer covers what HTML is, how tags and attributes work, how a browser turns it into a visible page, and where you can see it in the wild.

What HTML actually does

HTML is not a programming language. It doesn't perform calculations, make decisions, or run loops. It's a markup language: you wrap content in labels that describe its meaning and role.

That distinction matters. When you write <h1>Welcome</h1>, you're not saying "make this big and bold." You're saying "this is the top-level heading of the page." The browser decides the default appearance, and CSS can override it later. This separation — structure in HTML, presentation in CSS, behavior in JavaScript — is the core organizing principle of the modern web.

Elements, tags, and attributes

An element is the complete unit: an opening tag, the content, and a closing tag. A tag is the label itself, written between angle brackets. An attribute is extra information placed inside the opening tag.

Here's a simple example:

<h1 class="page-title">Welcome to My Site</h1>
<p>This is a paragraph of text with a <a href="https://example.com">link</a> inside it.</p>
<img src="photo.jpg" alt="A description of the photo">

Breaking that down:

A few things to notice. The <a> element uses an href attribute to say where the link points. The <img> element has no closing tag — it's a void element, because it holds no text content. And the alt attribute on the image provides a text alternative, which matters for accessibility and for when the image fails to load.

How a browser reads HTML and renders a page

When you visit a URL, the browser receives the HTML as plain text and works through it in a defined sequence:

1. Parsing — The browser reads the markup top to bottom and builds a tree structure called the DOM (Document Object Model). Each element becomes a node in that tree.
2. Applying CSS — Stylesheets are matched against the DOM to determine how each element should look.
3. Layout — The browser calculates where each element sits and how much space it takes.
4. Painting — Pixels are drawn to the screen.

The key insight is that the HTML you write is not the page you see. It's a set of instructions the browser interprets. Two browsers given identical HTML will produce nearly identical structure, but their default styling and rendering details can differ slightly — which is one reason developers test across browsers.

How HTML, CSS, and JavaScript divide the work

A typical site uses all three languages, each with a distinct job:

• HTML — structure and content. "This is a heading. This is a list. This is a form field."
• CSS — presentation. "Headings are dark blue, 32px, with 16px of space below."
• JavaScript — behavior. "When the user clicks this button, load more content."

You can build a perfectly readable page with HTML alone. Add CSS and it becomes visually designed. Add JavaScript and it becomes interactive. The same HTML can be restyled completely without touching its structure — which is why the separation is worth respecting rather than inlining styles and scripts everywhere.

Where to see HTML in practice

You don't need any tools to inspect a page's HTML:

• View source — Right-click anywhere on a page and choose "View Page Source" (or press Ctrl+U on Windows/Linux, Cmd+Option+U on Mac). This shows the raw HTML the server sent.
• Developer tools — Right-click an element and choose "Inspect." This opens the live DOM, which may differ from the raw source because JavaScript can modify it after the page loads.

Comparing the two is instructive. The raw source is what the server delivered; the inspected DOM is what the browser actually built. On a JavaScript-heavy site, they can look quite different.

A note on where this fits

HTML is the entry point to web work, but it's rarely used in isolation. If you're learning to build for the web, expect to pick up CSS and JavaScript alongside it. If you're simply trying to understand how a site you admire is put together, viewing its source and inspecting elements will show you the HTML structure directly — and that's often the fastest way to connect the abstract markup to a real page.

If you're new to Ahrefs and want to run your first SEO audit, the fastest path is: open Site Explorer, enter your target URL, review the Overview for a health snapshot, then dig into Organic Keywords, Top Pages, and Site Audit to find specific problems. From there, build a short prioritized to-do list instead of trying to fix everything at once.

This tutorial walks through that workflow using a realistic starting scenario, explains what the numbers mean, and shows how to turn findings into actions.

Before You Start: Pick a Narrow Scope

A common beginner mistake is auditing an entire large website on day one. The reports become overwhelming, and you can't tell which issues matter.

Instead, choose one of these starting points:

• A single important page (your homepage or a key product/service page)
• A small site (under ~50 pages, e.g., a personal blog or small business site)
• One section of a bigger site (e.g., /blog/)

For this tutorial, assume you're auditing a small business site with about 30 pages. The same steps scale up later.

You'll need an Ahrefs account to follow along. Ahrefs offers paid plans, and pricing and feature limits change over time, so check the current Pricing page for what's included in each tier before committing.

Step 1: Enter Your Target in Site Explorer

Site Explorer is Ahrefs' core tool for analyzing any website or URL.

1. Open Site Explorer from the top navigation.
2. In the search box, paste your domain (e.g., example.com).
3. Choose the Exact URL or Domain mode depending on scope. For a full-site view, use Domain or Prefix; for a single page, use Exact URL.
4. Press Enter.

You'll land on the Overview report. Don't try to absorb everything — focus on four numbers first.

Reading the Overview Snapshot

Important caveat: Ahrefs' traffic and keyword numbers are estimates based on its own data. They won't match Google Search Console or your analytics exactly. Treat them as directional, not absolute.

Step 2: See What You Already Rank For

Go to Organic Keywords in the left sidebar. This shows queries where your site appears in search results.

Sort by Traffic (descending) to see which pages bring the most estimated visitors. Then look for:

• Keywords ranking in positions 4–15 — these are often the easiest wins. A small content or on-page improvement can push them onto page one.
• Keywords with high volume but low position — potential opportunities if the topic is relevant.
• Irrelevant keywords — if you rank for something off-topic, it may signal thin or mismatched content.

Write down 5–10 of the position 4–15 keywords. These become your first optimization targets.

Step 3: Find Your Best and Weakest Pages

Open Top Pages. This ranks your URLs by estimated organic traffic.

Look for two things:

1. Your top performers — understand what topics and formats work. Can you create more content like this?
2. Pages with traffic but poor rankings — these may need on-page fixes (title, headings, internal links).

If a page gets zero traffic and targets a topic you care about, it's a candidate for a rewrite or consolidation.

Step 4: Run a Technical Site Audit

Now move to Site Audit. This crawls your site and flags technical and on-page issues.

1. Click Site Audit → New project.
2. Enter your domain and set crawl settings (default is usually fine for a small site).
3. Start the crawl and wait for it to finish.

Once complete, you'll see a Health Score and a list of issues grouped by category.

Which Issues to Fix First

Not all issues are equal. Prioritize in this order:

Ignore low-impact warnings (like minor meta description length) until the big items are handled.

Step 5: Turn Findings Into a To-Do List

You now have raw data. Convert it into a short, actionable list. Example:

1. Fix 3 broken links found in Site Audit.
2. Rewrite title tags on 5 pages with duplicate titles.
3. Improve 4 pages ranking in positions 6–12 by adding missing subtopics and internal links.
4. Remove or update 2 thin pages with no traffic.

Keep the list to 5–10 items max for your first audit. Finishing a short list beats starting a long one.

Common Beginner Mistakes

• Chasing every red flag. Site Audit flags many minor issues. Fix what affects rankings and users first.
• Trusting estimates as exact numbers. Ahrefs data is modeled, not measured from your analytics.
• Auditing a huge site too early. Start small to learn the interface.
• Ignoring search intent. A page can be technically perfect but still fail if it doesn't match what searchers want.
• Forgetting to re-crawl. After fixes, run Site Audit again to confirm improvements.

Where to Go Next

Once your first audit is done:

• Compare with competitors using Site Explorer's Competing Domains and Content Gap reports.
• Track keyword rankings over time with Rank Tracker.
• Explore backlink opportunities in the Backlinks and Link Intersect reports.
• Set up recurring Site Audit crawls so new issues surface automatically.

Your first audit isn't about perfection — it's about building a repeatable habit: enter a target, read the key reports, pick the highest-impact fixes, and act. Do that once a month and your site's health compounds.