@mattab opened this Issue on August 31st 2014 Owner

The goal of this ticket is to create an easy to use tool that will let anyone import in Piwik their Google Analytics data.

Features expected in this tool

  • Import one or several websites
  • Import data for all periods, or only import for a custom date range
  • For each website, we import the report data: Top pages, top events, top browsers, etc. (for the 50 reports available in Piwik or so)
  • Note: will not import the raw log visitor data since it is not available via Google Analytics API
  • Create a simple user interface, which uses a console command

    Tasks

  • Proposed name: Google Analytics Importer
  • Create new project at piwik/importer-google-analytics
  • This is a Piwik plugin published on the Marketplace
  • Let user connect via oAuth to the Google APIs, fetch automatically the profiles, websites available.
  • Run import via the UI or directly let user execute the console command
  • Test the importer on a few websites,
    • including a website with medium traffic to check that we work around Google API limits
  • Release the tool to public:

This issue requires #6094 (Create an API to let users import historical report data in Piwik)

@mcollopy commented on January 12th 2015

Will importing history from GA cause duplication in Piwik? e.g. For a site which has been using GA for a year, but only 3 months in Piwik, we might want to import the previous 9 months to get 1 year of history.
But not the overlapping recent 3 months.
Do you plan on deduping or providing a data range filter?
Thanks

@liebana commented on March 11th 2015

What's the overall status of this? It seems that there's no activity at all in both issues. Do you have this in your short term roadmap?

@mattab commented on March 11th 2015 Owner

There is no update and while it is currently in the Short term it may not be done in short term due to the complexity of the task. If you need this and have a budget, please contact Piwik PRO who may be able to help!

@dbrgn commented on March 25th 2015

This feature would be great!

@erotavlas85 commented on April 10th 2015

This is great feature!

@JagerBomb commented on April 20th 2015

We are really looking forward to this feature in our company. We cannot ask our clients to use our central Piwik installation until this has been released, since they have been relying on Google Analytics for too long and wish to keep their historical data.

@baptistedonaux commented on May 17th 2015

+1

@jdreesen commented on May 19th 2015

+1

@paul-cross commented on July 14th 2015

+1

@Maestro2k5 commented on July 29th 2015

+1

@phpdave11 commented on July 30th 2015

What about importing raw google analytics data? I have a copy of every hit saved, can these be imported into piwik?

@nickwright80 commented on August 1st 2015

+1

@berniezhao commented on August 5th 2015

+1

@Tomcraft1980 commented on August 15th 2015

+1

@aaronDeveloper commented on August 19th 2015

+1

@VelNZ commented on September 2nd 2015

+1

@gelldur commented on September 8th 2015

+1

@movak commented on September 9th 2015

+1

@ghost commented on September 18th 2015

+1

@MatthieuScarset commented on October 20th 2015

I'm in! What task need to be done first? :)

@L0garithmic commented on November 18th 2015

Come on guys, we need this!!!

@unknown23person commented on January 28th 2016

+1

@mgonera commented on February 17th 2016

+1

@Reamer commented on April 11th 2016

+1

@anacona16 commented on May 11th 2016

Hi, can you tell me the status for this issue?

@sgiehl commented on May 11th 2016 Member

Not sure if anyone is working on that at all :disappointed:

@Draky50110 commented on September 9th 2016

+1

@mattab commented on September 27th 2016 Owner

We won't be able to work on this, unless someone can sponsor us to work on it. Please contact us via https://piwik.org/development/ if you're able to sponsor the team!

@erotavlas85 commented on September 27th 2016

Why do not we/you create a crowdfounding campaign? I think it would be of great success...

@dbrgn commented on September 27th 2016

I'd certainly give a few dollars :)

@josephernest commented on October 23rd 2016

+10 (+10$ at least in a crowdfunding)

Possible already-available solution:

Is there a tool that allows us to export from Google Analytics to Apache-log similar access.log files?

Then it would be easy to re-import to Piwik, with import_logs.py...

What do you think?

@rosa2 commented on November 27th 2016

+1

@rosa2 commented on November 27th 2016

@mattab how much money do you need to make the programming? I am very interested to get it.

@cisarpavel commented on December 21st 2016

Do you have some estimate price/hours to develop this feature?

@zody0210 commented on December 25th 2016

+1
I am absolutely willing to pay for such a plugin/script.

@ryanhamilton commented on December 31st 2016

+1 would pay.

@viezel commented on January 13th 2017

+1 I would pay. @mattab can you create a kickstarter or similar?

@shaun-of-the-dead commented on March 5th 2017

Same for me. I'd be happy to contribute financially to help this feature / tool occur!

I have years of Google Analytics data logged before I learnt about Piwik, and I'm sure I'm not the only one. There'd be great value in implementing a tool like this if you guys can pull it off.

@machampagne commented on March 28th 2017

We are also willing to chip in for this feature.

@DJLunacy commented on April 26th 2017

Bueller?

@nopynoop commented on July 21st 2017

+1

@erotavlas85 commented on July 21st 2017

We could use patreon.
Take a look at this or this.

@SzymonDukla commented on September 26th 2017

I would like to offer a development of such functionalities (that includes the API and the plugin to import GA data). A monthly financial contribution is crucial. Do you want me to set up a Patreon (or similar)?
In case of questions, please ask on sd@szymondukla.co.uk

@mattab commented on September 26th 2017 Owner

We'd also like to work on this, but so far the problem is how would it technically work? @SzymonDukla do you have some thoughts on this? we haven't found a GA API that we can use to import all the data safely and accurately yet...

@SzymonDukla commented on September 27th 2017

I have a project behind me now that involves Analytics data gathering through GA API. It's nearly (as close as we can really get) to raw data. I have a nice and flexible API wrapper written in PHP I'm going to use.
I've set up a Patreon: https://www.patreon.com/ga_for_piwik
I'll be answering all the questions on there.

@mattab commented on September 29th 2017 Owner

Hi @SzymonDukla what's your idea of getting as close as you can get raw data? would you call the GA API with many dimensions to get raw data or so?

@fabrice-regnier commented on October 11th 2017

+1 i'd pay too. Please,please, help us to opt out of GA. I guess it would be a great functionnality of piwik!

I can see chats are going on on this subject, nice.

regards.
f.

@SzymonDukla commented on October 13th 2017

Sorry for the delay, last two weeks have been crazy...
Getting back on this project, that's correct @mattab - I have a side project that involves getting and storing all the possible data from GA accounts and then generating monthly/weekly/yearly SEO reports based on that so I think I will have the same approach which is getting as many metrics in as many configurations (as some metrics are now working with other ones) exported into a JSON or similar file that then will be imported via Piwik plugin, processed and merged into Piwik itself.

@fabrice-regnier, thank you very much for your interest! I do that because I have the same problem - years worth of data on Google I have no way to export.

As mentioned, I've set up a Patreon (https://www.patreon.com/ga_for_piwik), let's move all further discussion on this project there for those interested :)

@mattab commented on October 15th 2017 Owner

will have the same approach which is getting as many metrics in as many configurations (as some metrics are now working with other ones) exported into a JSON or similar file that then will be imported via Piwik plugin, processed and merged into Piwik itself.

Did you mean 'metrics' or rather 'dimensions'? Our previous version of the GA importer (since deprecated) used this trick, the problem was that back in the days there were not enough precise dimensions, so we couldn't get useful "Per visitor" information and import all visitors.
Could you show us an example of how you'll export the GA data to then import it in Piwik?

Powered by GitHub Issue Mirror