CompositeDoc: The Master Document Profile in Google's Content Warehouse (Google Leak - Module Types)

Last Updated: July 28th, 2024

Within Google's search engine architecture, the "CompositeDoc" module stands as a central pillar, meticulously crafted to encapsulate the wealth of information Google gathers about a single web document.

Revealed in the leaked "Content Warehouse" documentation, CompositeDoc acts as a comprehensive repository, integrating data from various sources and analysis processes to create a holistic representation of a page's characteristics, content, and signals.

Role of the CompositeDoc Modules

Imagine CompositeDoc as a detailed dossier, a single source of truth that Google consults when evaluating a web page's relevance, quality, authority, and user experience. It brings together data from crawling, rendering, content analysis, link analysis, user engagement metrics, spam detection systems, and more, providing a unified view of a document's attributes and signals.

Key Data Categories Within CompositeDoc

Document Content and Metadata

• GDocumentBase.t: Contains the core content of the document, including its raw HTML, text extracts, and potentially other representations (e.g., PDF content).
• DocProperties.t: Stores key document properties such as language, title, meta description, and various content length and structure metrics.
• PerDocData.t: Holds a vast array of signals related to content quality, authority, user engagement, mobile-friendliness, spam detection, freshness, and more.

Link and Anchor Data

• Anchors.t: Represents the anchor text and properties of links pointing to the document, including information about the linking pages.
• IndexingDocjoinerAnchorStatistics.t: Contains statistics about the anchor text, such as redundancy, spam signals, and forwarding information.

Canonicalization and Duplication Information

• CompositeDocForwardingDup: Represents forwarding duplicates, which are other URLs that redirect to or are considered duplicates of the main document.
• IndexingDupsLocalizedLocalizedCluster.t: Contains information about localized clusters, which are groups of URLs that represent the same content in different languages or regions.

Crawling and Indexing Signals

• CompositeDocIndexingInfo.t: Holds information about the crawl status of the document, any errors encountered, and reasons for potential exclusion from the index.
• IndexingDocjoinerDataVersion.t: Tracks the versions of various data fields within the document, enabling controlled updates and consistency.

User Experience and Mobile Optimization Signals

• SmartphonePerDocData.t: Contains signals related to mobile optimization and user experience, such as mobile-friendliness, interstitial penalties, and page speed metrics.
• IndexingMobileVoltVoltPerDocData.t: Holds data from Google's Volt system, which assesses mobile performance and user experience.

Content Features and Rich Snippets

• RichsnippetsPageMap.t: Represents rich snippets extracted from the document's content, based on structured data markup.
• QualityRichsnippetsAppsProtosLaunchAppInfoPerDocData.t: Contains information about apps associated with the document, potentially used for app indexing.

Spam Detection Signals

• ClassifierPornDocumentData.t: Holds data related to spam and potentially adult content detection.
• perdocdata.spambrainData.t: Represents data from Google's SpamBrain system, including spam scores and signals.

Examples of CompositeDoc Sub-Modules

• CompositeDoc.doc: Contains the core document data, including the parsed HTML, text extracts, and other representations.
• CompositeDoc.properties: Stores key document properties like language, title, and meta description.
• CompositeDoc.anchors: Represents the anchor text and properties of links pointing to the document.
• CompositeDoc.indexinginfo: Holds information about the crawl status, errors, and indexing decisions.
• CompositeDoc.localizedvariations: Contains information about localized alternate URLs for different languages and regions.

Conclusion

The CompositeDoc module provides a comprehensive view of how Google analyzes and understands web documents. By examining the various data points and signals contained within this structure, SEOs can gain valuable insights into the factors that influence search rankings and optimize their websites accordingly.

Key Takeaways

• Holistic Evaluation: Google's assessment of web pages is multifaceted, encompassing content, technical factors, user experience, authority, and spam detection.
• Data Integration: CompositeDoc integrates data from numerous sources and systems, creating a unified and detailed document profile.
• SEO Actionability: While the specific weighting and interplay of signals remain unknown, understanding the data categories within CompositeDoc can guide SEOs in optimizing their websites for better visibility and performance in Google Search.