All Collections
Product Updates
Bulk Advanced Web Ranking data exports to BigQuery via direct connector
Bulk Advanced Web Ranking data exports to BigQuery via direct connector

Learn how to configure and utilize the new AWR connector for automatic daily bulk data exports to BigQuery

Larisa Rosu avatar
Written by Larisa Rosu
Updated over a week ago

Google API Disclosure

AWR's use and transfer to any other app of information received from Google APIs will adhere to Google API Services User Data Policy, including the Limited Use requirements.

We are excited to announce that we have introduced a new connector in AWR, allowing for automatic daily bulk data exports directly to BigQuery. The new connector enables AWR users to effortlessly export the Ranking, Visibility, and Marketshare data to BigQuery, providing more flexibility and convenience in managing and analyzing big sets of SEO data.

With daily bulk data exports to BigQuery, you can now access and leverage the AWR data directly within the powerful analytics capabilities of BigQuery. This integration opens up new possibilities for advanced data analysis, custom reporting, and deeper insights into SEO performance.

πŸ’‘ To benefit from this feature, you will need access to an AWR subscription starting at the monthly Enterprise level or any yearly plan. Additionally, familiarity with the Google Cloud platform and the BigQuery service is required.

πŸ’‘ Please note that leveraging with BigQuery may be subject to storage and query costs. Every Cloud project that you create has a billing account attached to it. Charges for BigQuery operations run in the project and storage are billed to the attached billing account.

BigQuery offers free operations and a free usage tier, but query and storage usage above the free usage level will be charged. You can view BigQuery costs by accessing the Billing reports in your Cloud Console.

Configure and start an ongoing bulk data export

To establish the connection between AWR and BigQuery and start an ongoing bulk data export, you must complete a few tasks on both apps.

In Google Cloud Console (BigQuery)

Open your Google Cloud Console and select an existing/create a new Google Cloud project to which the AWR data should be exported to.

Check if BigQuery is enabled for this project. From the sidebar menu, access the APIs & Services > Enabled APIs & Services section.

Screenshot 2023-07-14 at 14

If BigQuery is not enabled, click + ENABLE APIS AND SERVICES and search for BigQuery API in the API library. Select it, then click Enable BigQuery API.

Screenshot 2023-07-14 at 14

In Advanced Web Ranking

After setting up your project on Google Cloud as described above go to Settings > Connectors & API > Google BigQuery section of your AWR account.

πŸ’‘ The BiqQuery sync can be enabled by the superuser (subscription owner) or by users who have administrative rights for the subscription. Team members do not have access to this setting.

Click on the Sign in with Google button and select the email address associated with the Google Cloud project to which the AWR data (.CSV files) should be uploaded to.

Allow AWR to access your Google account, insert and manage data in BigQuery.

Screenshot 2023-07-14 at 15

Select the type of data to the uploaded - Ranking, Visibility, and/or Marketshare - and the Cloud project to which the files should be dumped.

Furthermore, select the AWR projects for which the exports should run, then click Save Google BiqQuery settings button.

After enabling the sync, the first batch of AWR data is dumped into the selected Cloud project in the following couple of hours, then exports will be uploaded every day.

πŸ’‘ Please note that the AWR data will accumulate forever in your Cloud project. To avoid accruing data indefinitely and effectively manage storage costs you can set appropriate partition expiration times.

The daily exports will continue until the sync is manually deactivated in Settings > Connectors & API > Google BigQuery section.

Do you have any further questions or need more information about this product update? Don't hesitate to get in touch with our dedicated support team.

Did this answer your question?