migration-tools.git
7 days agohave mig-import remove memcache keys and restart plack master
Rogan Hamby [Fri, 26 Jun 2020 16:39:56 +0000]
have mig-import remove memcache keys and restart plack

7 days agominor bugfixs to mig-import
Rogan Hamby [Fri, 26 Jun 2020 16:08:33 +0000]
minor bugfixs to mig-import

8 days agoteach mig-import to bring in message preferences
Rogan Hamby [Thu, 25 Jun 2020 21:38:56 +0000]
teach mig-import to bring in message preferences

8 days agomig-export now does message preferences
Rogan Hamby [Thu, 25 Jun 2020 20:22:58 +0000]
mig-export now does message preferences

8 days agomissed a few lines to cleanup and move ALTER statements to sql_noresult
Rogan Hamby [Thu, 25 Jun 2020 20:04:04 +0000]
missed a few lines to cleanup and move ALTER statements to sql_noresult

8 days agomoving libraries, patroncategories and itemtypes to the front of the restore list...
Rogan Hamby [Thu, 25 Jun 2020 19:55:35 +0000]
moving libraries, patroncategories and itemtypes to the front of the restore list to make sure they are done first

8 days agoteach mig-export to use a sql query function instead of implementing the same lines...
Rogan Hamby [Thu, 25 Jun 2020 19:45:14 +0000]
teach mig-export to use a sql query function instead of implementing the same lines over and over

8 days agoteach mig import to use some funcitons for sql queries to reduce line count and impro...
Rogan Hamby [Thu, 25 Jun 2020 19:24:52 +0000]
teach mig import to use some funcitons for sql queries to reduce line count and improve readability and make a few functions more consistnet in how they check existing data

8 days agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Thu, 25 Jun 2020 18:46:27 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

8 days agomaking restore_itemtypes consistent with using check_itemtype
Rogan Hamby [Thu, 25 Jun 2020 18:46:08 +0000]
making restore_itemtypes consistent with using check_itemtype

9 days agom_upsert_datafield for kmig
Jason Etheridge [Wed, 24 Jun 2020 18:58:01 +0000]
m_upsert_datafield for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 weeks agologic checking category code and item type on isssues and circ rules as well as error log
Rogan Hamby [Fri, 19 Jun 2020 21:19:02 +0000]
logic checking category code and item type on isssues and circ rules as well as error log

2 weeks agoadd mysql function to remove non-alphanumeric characters
Rogan Hamby [Wed, 17 Jun 2020 13:09:04 +0000]
add mysql function to remove non-alphanumeric characters

2 weeks agodon't allow systempreferences to be null
Rogan Hamby [Tue, 16 Jun 2020 19:12:50 +0000]
don't allow systempreferences to be null

2 weeks agoadding letter syncing to kmig import and export
Rogan Hamby [Tue, 16 Jun 2020 18:30:05 +0000]
adding letter syncing to kmig import and export

2 weeks agom_insert_tag for kmig
Jason Etheridge [Mon, 15 Jun 2020 15:53:00 +0000]
m_insert_tag for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 weeks agofixing typo that caused a false value assignment
Rogan Hamby [Fri, 12 Jun 2020 17:10:53 +0000]
fixing typo that caused a false value assignment

3 weeks agoa quality of life function to make it easier to modify the fixed fields in a biblio...
Rogan Hamby [Thu, 11 Jun 2020 15:35:09 +0000]
a quality of life function to make it easier to modify the fixed fields in a biblio.record_entry record

3 weeks agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 10 Jun 2020 17:42:04 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

3 weeks agoadding better category support to authorised values import/export in kmig
Rogan Hamby [Wed, 10 Jun 2020 17:41:47 +0000]
adding better category support to authorised values import/export in kmig

3 weeks agokoha function for updating the 003 tag
Jason Etheridge [Tue, 9 Jun 2020 19:35:29 +0000]
koha function for updating the 003 tag

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 weeks agofixed help error in mig-stagebibs for emig
Rogan Hamby [Mon, 8 Jun 2020 16:42:25 +0000]
fixed help error in mig-stagebibs for emig

3 weeks agofixing on mung_sf9 where it declares int instead of bigint for bib ids
Rogan Hamby [Mon, 8 Jun 2020 16:19:10 +0000]
fixing on mung_sf9 where it declares int instead of bigint for bib ids

3 weeks agoadding a strip subfield function
Rogan Hamby [Mon, 8 Jun 2020 16:17:59 +0000]
adding a strip subfield function

4 weeks agomig-import missed a clause for deleting from the itemtypes table
Rogan Hamby [Wed, 3 Jun 2020 15:39:14 +0000]
mig-import missed a clause for deleting from the itemtypes table

4 weeks agofixed xpath issues with restore_itemtypes
Rogan Hamby [Wed, 3 Jun 2020 15:10:41 +0000]
fixed xpath issues with restore_itemtypes

4 weeks agoadded to kmig bookseller and budget support to import and export
Rogan Hamby [Tue, 2 Jun 2020 20:15:34 +0000]
added to kmig bookseller and budget support to import and export

4 weeks agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:23 +0000]
adding the start of base sql and marc functions for koha to mig-init

4 weeks agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:08 +0000]
adding the start of base sql and marc functions for koha to mig-init

4 weeks agobase staging tables for koha added for kmig.d/init
Rogan Hamby [Tue, 2 Jun 2020 13:42:49 +0000]
base staging tables for koha added for kmig.d/init

5 weeks agoreplace borrower_attributes with borrowerattributes for file name in mig-export
Rogan Hamby [Thu, 28 May 2020 17:46:35 +0000]
replace borrower_attributes with borrowerattributes for file name in mig-export

5 weeks agoadding borrower attributes to mig import/export
Rogan Hamby [Wed, 27 May 2020 20:33:51 +0000]
adding borrower attributes to mig import/export

5 weeks agoadding m_ for koha functions and an update_leader function
Rogan Hamby [Wed, 27 May 2020 15:52:37 +0000]
adding m_ for koha functions and an update_leader function

6 weeks agokmig import/export now support syncing reports
Rogan Hamby [Thu, 21 May 2020 20:58:28 +0000]
kmig import/export now support syncing reports

6 weeks agovarious enhacnements to emig bibstats including adding it to kmig
Rogan Hamby [Tue, 19 May 2020 20:16:03 +0000]
various enhacnements to emig bibstats including adding it to kmig

6 weeks agoadded profile for Destiny to mig bibstats
Rogan Hamby [Tue, 19 May 2020 17:21:33 +0000]
added profile for Destiny to mig bibstats

8 weeks agoadjust -test components of kohacatalog.com domains in kmig import
Rogan Hamby [Thu, 7 May 2020 14:41:01 +0000]
adjust -test components of kohacatalog.com domains in kmig import

8 weeks agoadd some new koha reports
Rogan Hamby [Tue, 5 May 2020 19:17:01 +0000]
add some new koha reports

8 weeks agochange default behavior for no --analyst tag
Rogan Hamby [Mon, 4 May 2020 19:33:36 +0000]
change default behavior for no --analyst tag

2 months agoset ->do('SET NAMES utf8mb4'); by default
Rogan Hamby [Mon, 4 May 2020 15:50:38 +0000]
set ->do('SET NAMES utf8mb4'); by default

2 months agomore robust versions of kmig import and export
Rogan Hamby [Mon, 4 May 2020 15:49:40 +0000]
more robust versions of kmig import and export

2 months agosimplify a few exports and add one for itemtypes
Rogan Hamby [Wed, 22 Apr 2020 19:10:20 +0000]
simplify a few exports and add one for itemtypes

2 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:34 +0000]
updated mig export to use xml and mig import supports libraries and preferences

2 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:22 +0000]
updated mig export to use xml and mig import supports libraries and preferences

2 months agoinitial version of mig-export added for kmig
Rogan Hamby [Fri, 17 Apr 2020 16:22:50 +0000]
initial version of mig-export added for kmig

2 months agounneeded variable declaration removed
Rogan Hamby [Thu, 16 Apr 2020 18:54:00 +0000]
unneeded variable declaration removed

2 months agoremoving no longer needed parameter
Rogan Hamby [Thu, 16 Apr 2020 18:51:43 +0000]
removing no longer needed parameter

2 months agodon't index x_count if we see it
Jason Etheridge [Thu, 16 Apr 2020 14:38:14 +0000]
don't index x_count if we see it

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agodefault charset and collate for csv2mysql
Jason Etheridge [Thu, 16 Apr 2020 14:36:45 +0000]
default charset and collate for csv2mysql

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agofirst cut of kmig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:48:16 +0000]
first cut of kmig-quick

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agoseed kmig-quick with emig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:47:29 +0000]
seed kmig-quick with emig-quick

2 months agoif we come across these, make them BIGINT. mysql/mariadb can't index TEXT
Jason Etheridge [Wed, 15 Apr 2020 20:32:46 +0000]
if we come across these, make them BIGINT. mysql/mariadb can't index TEXT

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agomake sure worksheet names do not go over 31 characters
Jason Etheridge [Wed, 15 Apr 2020 20:31:11 +0000]
make sure worksheet names do not go over 31 characters

2 months agosimplifying defaults a bit
Rogan Hamby [Wed, 15 Apr 2020 18:11:06 +0000]
simplifying defaults a bit

2 months agoadding kmig reporter
Rogan Hamby [Wed, 15 Apr 2020 18:09:17 +0000]
adding kmig reporter

2 months agowe don't need to pre-create Koha staging tables since mig link and mig stage can... kmig
Jason Etheridge [Fri, 10 Apr 2020 21:00:42 +0000]
we don't need to pre-create Koha staging tables since mig link and mig stage can do it

2 months agofirst cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent...
Jason Etheridge [Fri, 10 Apr 2020 21:00:12 +0000]
first cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent tables, since based on the naming convention we can vivicate them

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agoseed kmig-stage with emig-stage
Jason Etheridge [Fri, 10 Apr 2020 20:48:24 +0000]
seed kmig-stage with emig-stage

2 months agofirst cut of csv2mysql, mig-convert, and a needed tweak for mig-sql
Jason Etheridge [Fri, 10 Apr 2020 20:47:09 +0000]
first cut of csv2mysql, mig-convert, and a needed tweak for mig-sql

2 months agomove csv2mysql into the kmig hierarchy so we can better leverage KMig.pm
Jason Etheridge [Fri, 10 Apr 2020 20:03:57 +0000]
move csv2mysql into the kmig hierarchy so we can better leverage KMig.pm

2 months agoseed csv2mysql with csv2sql
Jason Etheridge [Fri, 10 Apr 2020 20:01:53 +0000]
seed csv2mysql with csv2sql

2 months agoseed kmig-convert with emig-convert
Jason Etheridge [Fri, 10 Apr 2020 19:53:43 +0000]
seed kmig-convert with emig-convert

2 months agofirst cut of kmig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:31:31 +0000]
first cut of kmig-unlink

2 months agoseed kmig-unlink with emig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:29:44 +0000]
seed kmig-unlink with emig-unlink

2 months agofirst cut of kmig-link
Jason Etheridge [Fri, 10 Apr 2020 19:29:18 +0000]
first cut of kmig-link

2 months agoseed kmig-link with emig-link
Jason Etheridge [Fri, 10 Apr 2020 19:21:48 +0000]
seed kmig-link with emig-link

2 months agomore path touchups
Jason Etheridge [Fri, 10 Apr 2020 19:20:37 +0000]
more path touchups

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agomig wrapper to kmig/emig
Jason Etheridge [Fri, 10 Apr 2020 18:44:58 +0000]
mig wrapper to kmig/emig

It won't handle first time setup; you'll need to call emig or kmig explicitly
until an environment is loaded.

Example:

    kmig env create demo
    kmig env use demo
    mig init
    mig add foo.txt etc

Also, the older ~/.mig environment directory, if used with the new mig, will
need to be moved or merged into ~/.emig, and the various *.env files ammended
with:

    export MIGCMD=emig

2 months agorewire to match the new naming scheme and layout
Jason Etheridge [Fri, 10 Apr 2020 18:28:17 +0000]
rewire to match the new naming scheme and layout

2 months agolet's not name these differently than the emig.d/ counterparts
Jason Etheridge [Fri, 10 Apr 2020 18:13:08 +0000]
let's not name these differently than the emig.d/ counterparts

2 months agotoward renaming mig to emig and tweaking the directory layout
Jason Etheridge [Fri, 10 Apr 2020 18:05:56 +0000]
toward renaming mig to emig and tweaking the directory layout

2 months agofirst cuts of kmig-*iconv
Jason Etheridge [Fri, 10 Apr 2020 17:57:28 +0000]
first cuts of kmig-*iconv

2 months agoseed kmig-*iconv with mig-*iconv
Jason Etheridge [Fri, 10 Apr 2020 17:54:59 +0000]
seed kmig-*iconv with mig-*iconv

2 months agofirst cut of kmig-clean
Jason Etheridge [Fri, 10 Apr 2020 17:54:19 +0000]
first cut of kmig-clean

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agoseed kmig-clean with mig-clean
Jason Etheridge [Fri, 10 Apr 2020 17:51:52 +0000]
seed kmig-clean with mig-clean

2 months agofirst cut of kmig-status
Jason Etheridge [Fri, 10 Apr 2020 16:21:19 +0000]
first cut of kmig-status

2 months agoseed kmig-status from mig-status
Jason Etheridge [Fri, 10 Apr 2020 16:20:10 +0000]
seed kmig-status from mig-status

2 months agofirst cut of kmig-remove
Jason Etheridge [Fri, 10 Apr 2020 16:18:53 +0000]
first cut of kmig-remove

2 months agoseed kmig-remove from mig-remove
Jason Etheridge [Fri, 10 Apr 2020 16:15:55 +0000]
seed kmig-remove from mig-remove

2 months agofirst cut of kmig-add
Jason Etheridge [Fri, 10 Apr 2020 16:13:45 +0000]
first cut of kmig-add

2 months agoseed kmig-add from mig-add
Jason Etheridge [Fri, 10 Apr 2020 16:10:08 +0000]
seed kmig-add from mig-add

2 months agoremove the migration-tools expectation for kmig
Jason Etheridge [Fri, 10 Apr 2020 16:06:29 +0000]
remove the migration-tools expectation for kmig

2 months agofirst cut of kmig-init
Jason Etheridge [Fri, 10 Apr 2020 15:43:43 +0000]
first cut of kmig-init

2 months agokmig-sql: kthere IS a way to pass session variables from the command-line and still...
Jason Etheridge [Fri, 10 Apr 2020 15:22:43 +0000]
kmig-sql: kthere IS a way to pass session variables from the command-line and still get a shell

2 months agoseed kmig-init from mig-init
Jason Etheridge [Fri, 10 Apr 2020 02:31:01 +0000]
seed kmig-init from mig-init

2 months agofirst cut off kmig-sql, and a needed fix to kmig
Jason Etheridge [Fri, 10 Apr 2020 02:29:59 +0000]
first cut off kmig-sql, and a needed fix to kmig

2 months agoseed kmig-sql from mig-sql
Jason Etheridge [Fri, 10 Apr 2020 02:04:17 +0000]
seed kmig-sql from mig-sql

2 months agofirst cut of kmig-env, and KMig.pm comment tweak
Jason Etheridge [Thu, 9 Apr 2020 21:51:54 +0000]
first cut of kmig-env, and KMig.pm comment tweak

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agoseed kmig-env from mig-env
Jason Etheridge [Thu, 9 Apr 2020 20:17:50 +0000]
seed kmig-env from mig-env

2 months agofirst cut of KMig.pm
Jason Etheridge [Thu, 9 Apr 2020 20:13:06 +0000]
first cut of KMig.pm

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agofirst cut of kmig
Jason Etheridge [Tue, 7 Apr 2020 20:49:36 +0000]
first cut of kmig

2 months agoseed KMig.pm with Mig.pm
Jason Etheridge [Tue, 7 Apr 2020 20:46:41 +0000]
seed KMig.pm with Mig.pm

2 months agoseed kmig with mig
Jason Etheridge [Tue, 7 Apr 2020 20:20:18 +0000]
seed kmig with mig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 months agoadd a tab listing up to 65k rows of the actual data being summarized. Only for excel...
Jason Etheridge [Tue, 31 Mar 2020 20:14:00 +0000]
add a tab listing up to 65k rows of the actual data being summarized.  Only for excel, not the SQL output

3 months agofor convenience, add some other values to handle_not_migrate
Jason Etheridge [Mon, 23 Mar 2020 16:52:12 +0000]
for convenience, add some other values to handle_not_migrate

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 months agotesting for == 0
Rogan Hamby [Thu, 19 Mar 2020 13:27:55 +0000]
testing for  == 0

3 months ago--ignore_filetype flag added
Rogan Hamby [Fri, 6 Mar 2020 22:10:16 +0000]
--ignore_filetype flag added

3 months agocleaned up docs
Rogan Hamby [Fri, 6 Mar 2020 19:21:08 +0000]
cleaned up docs

3 months agoadd ability to specify div height and width from xml and donut chart type
Rogan Hamby [Fri, 6 Mar 2020 19:12:24 +0000]
add ability to specify div height and width from xml and donut chart type

3 months agofurther enchancements to mig-bibstats
Rogan Hamby [Thu, 5 Mar 2020 18:26:30 +0000]
further enchancements to mig-bibstats