migration-tools.git
2 months agochange to the data directly automatically with mig env use master
Jason Etheridge [Fri, 28 Aug 2020 13:25:04 +0000]
change to the data directly automatically with mig env use

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agothinko fixing the thinko :D one should test before commiting
Jason Etheridge [Tue, 11 Aug 2020 19:36:20 +0000]
thinko fixing the thinko :D one should test before commiting

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agothinko with branch handling
Jason Etheridge [Tue, 11 Aug 2020 19:34:45 +0000]
thinko with branch handling

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agofor mig bibstats
Jason Etheridge [Tue, 11 Aug 2020 17:09:36 +0000]
for mig bibstats

--item_type_subfield will make use of --holding_code and provide a breakdown of
bib types by item types.  If --branch_subfield is also provided, then the
breakdown will be further subdivided by branch.

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 months agoconvert tabs to spaces for my sanity :)
Jason Etheridge [Tue, 11 Aug 2020 15:39:30 +0000]
convert tabs to spaces for my sanity :)

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 months agomake the straight listing of rows for the file optional via --list
Jason Etheridge [Fri, 31 Jul 2020 14:46:31 +0000]
make the straight listing of rows for the file optional via --list

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

3 months agorenamed file since acq was added to it
Rogan Hamby [Thu, 23 Jul 2020 19:15:41 +0000]
renamed file since acq was added to it

3 months agoadd event output removal
Rogan Hamby [Wed, 22 Jul 2020 19:37:28 +0000]
add event output removal

3 months agorename 13 to be more accurate
Rogan Hamby [Wed, 22 Jul 2020 19:16:26 +0000]
rename 13 to be more accurate

3 months agoadding acq stuff into patron extras file
Rogan Hamby [Wed, 22 Jul 2020 19:01:06 +0000]
adding acq stuff into patron extras file

3 months agoremoving copy alerts
Rogan Hamby [Wed, 22 Jul 2020 18:20:36 +0000]
removing copy alerts

3 months agoremove account adjustment entries
Rogan Hamby [Wed, 22 Jul 2020 14:20:59 +0000]
remove account adjustment entries

3 months agoremove inventory data
Rogan Hamby [Tue, 21 Jul 2020 19:58:29 +0000]
remove inventory data

3 months agohandling foreign owned reports of templates to be deleted when they aren't scheduled...
Rogan Hamby [Tue, 21 Jul 2020 19:52:31 +0000]
handling foreign owned reports of templates to be deleted when they aren't scheduled in the future

3 months agoorder of operations improvement on org removal scripts
Rogan Hamby [Tue, 21 Jul 2020 13:52:33 +0000]
order of operations improvement on org removal scripts

3 months agomoving serials before copy templates to resolve an order of operatiosn issue
Rogan Hamby [Tue, 21 Jul 2020 13:42:54 +0000]
moving serials before copy templates to resolve an order of operatiosn issue

3 months agofixing thinko
Rogan Hamby [Tue, 21 Jul 2020 13:28:53 +0000]
fixing thinko

3 months agoadding the create exceeds fines function
Rogan Hamby [Mon, 20 Jul 2020 20:37:56 +0000]
adding the create exceeds fines function

3 months agomake mig-bibstats able to read marcxml or marc21
Rogan Hamby [Tue, 14 Jul 2020 17:32:58 +0000]
make mig-bibstats able to read marcxml or marc21

3 months agoenhancements to mig prepbibs
Rogan Hamby [Tue, 14 Jul 2020 16:56:29 +0000]
enhancements to mig prepbibs

3 months agomoving kmig referene to emig for evergreen version of prepbibs
Rogan Hamby [Tue, 14 Jul 2020 15:33:22 +0000]
moving kmig referene to emig for evergreen version of prepbibs

3 months agomaking the null out columns functions able to handle the term NULL and a single space...
Rogan Hamby [Tue, 14 Jul 2020 13:34:39 +0000]
making the null out columns functions able to handle the term NULL and a single space in case they haven't been trimmed

3 months agoadding emig prepbibs function
Rogan Hamby [Mon, 13 Jul 2020 15:32:49 +0000]
adding emig prepbibs function

3 months agoadding prep bibs to move 999s to 998s
Rogan Hamby [Mon, 13 Jul 2020 15:26:01 +0000]
adding prep bibs to move 999s to 998s

3 months agoadd warning for 999 fields and change name of app to use
Rogan Hamby [Mon, 13 Jul 2020 14:57:38 +0000]
add warning for 999 fields and change name of app to use

3 months agoadd warning for 999 fields
Rogan Hamby [Mon, 13 Jul 2020 14:56:28 +0000]
add warning for 999 fields

3 months agomake a message more meaningful
Rogan Hamby [Mon, 13 Jul 2020 14:48:22 +0000]
make a message more meaningful

3 months agoRevert "moar data"
Jason Etheridge [Tue, 7 Jul 2020 17:46:11 +0000]
Revert "moar data"

This reverts commit 7133775722f9c0c65a40571a3e71a90d2c0a27b2.

3 months agomoar data
Jason Etheridge [Mon, 6 Jul 2020 21:31:41 +0000]
moar data

4 months agohave mig-import remove memcache keys and restart plack
Rogan Hamby [Fri, 26 Jun 2020 16:39:56 +0000]
have mig-import remove memcache keys and restart plack

4 months agominor bugfixs to mig-import
Rogan Hamby [Fri, 26 Jun 2020 16:08:33 +0000]
minor bugfixs to mig-import

4 months agoteach mig-import to bring in message preferences
Rogan Hamby [Thu, 25 Jun 2020 21:38:56 +0000]
teach mig-import to bring in message preferences

4 months agomig-export now does message preferences
Rogan Hamby [Thu, 25 Jun 2020 20:22:58 +0000]
mig-export now does message preferences

4 months agomissed a few lines to cleanup and move ALTER statements to sql_noresult
Rogan Hamby [Thu, 25 Jun 2020 20:04:04 +0000]
missed a few lines to cleanup and move ALTER statements to sql_noresult

4 months agomoving libraries, patroncategories and itemtypes to the front of the restore list...
Rogan Hamby [Thu, 25 Jun 2020 19:55:35 +0000]
moving libraries, patroncategories and itemtypes to the front of the restore list to make sure they are done first

4 months agoteach mig-export to use a sql query function instead of implementing the same lines...
Rogan Hamby [Thu, 25 Jun 2020 19:45:14 +0000]
teach mig-export to use a sql query function instead of implementing the same lines over and over

4 months agoteach mig import to use some funcitons for sql queries to reduce line count and impro...
Rogan Hamby [Thu, 25 Jun 2020 19:24:52 +0000]
teach mig import to use some funcitons for sql queries to reduce line count and improve readability and make a few functions more consistnet in how they check existing data

4 months agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Thu, 25 Jun 2020 18:46:27 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

4 months agomaking restore_itemtypes consistent with using check_itemtype
Rogan Hamby [Thu, 25 Jun 2020 18:46:08 +0000]
making restore_itemtypes consistent with using check_itemtype

4 months agom_upsert_datafield for kmig
Jason Etheridge [Wed, 24 Jun 2020 18:58:01 +0000]
m_upsert_datafield for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

4 months agologic checking category code and item type on isssues and circ rules as well as error log
Rogan Hamby [Fri, 19 Jun 2020 21:19:02 +0000]
logic checking category code and item type on isssues and circ rules as well as error log

4 months agoadd mysql function to remove non-alphanumeric characters
Rogan Hamby [Wed, 17 Jun 2020 13:09:04 +0000]
add mysql function to remove non-alphanumeric characters

4 months agodon't allow systempreferences to be null
Rogan Hamby [Tue, 16 Jun 2020 19:12:50 +0000]
don't allow systempreferences to be null

4 months agoadding letter syncing to kmig import and export
Rogan Hamby [Tue, 16 Jun 2020 18:30:05 +0000]
adding letter syncing to kmig import and export

4 months agom_insert_tag for kmig
Jason Etheridge [Mon, 15 Jun 2020 15:53:00 +0000]
m_insert_tag for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

4 months agofixing typo that caused a false value assignment
Rogan Hamby [Fri, 12 Jun 2020 17:10:53 +0000]
fixing typo that caused a false value assignment

4 months agoa quality of life function to make it easier to modify the fixed fields in a biblio...
Rogan Hamby [Thu, 11 Jun 2020 15:35:09 +0000]
a quality of life function to make it easier to modify the fixed fields in a biblio.record_entry record

4 months agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 10 Jun 2020 17:42:04 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

4 months agoadding better category support to authorised values import/export in kmig
Rogan Hamby [Wed, 10 Jun 2020 17:41:47 +0000]
adding better category support to authorised values import/export in kmig

4 months agokoha function for updating the 003 tag
Jason Etheridge [Tue, 9 Jun 2020 19:35:29 +0000]
koha function for updating the 003 tag

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

4 months agofixed help error in mig-stagebibs for emig
Rogan Hamby [Mon, 8 Jun 2020 16:42:25 +0000]
fixed help error in mig-stagebibs for emig

4 months agofixing on mung_sf9 where it declares int instead of bigint for bib ids
Rogan Hamby [Mon, 8 Jun 2020 16:19:10 +0000]
fixing on mung_sf9 where it declares int instead of bigint for bib ids

4 months agoadding a strip subfield function
Rogan Hamby [Mon, 8 Jun 2020 16:17:59 +0000]
adding a strip subfield function

4 months agomig-import missed a clause for deleting from the itemtypes table
Rogan Hamby [Wed, 3 Jun 2020 15:39:14 +0000]
mig-import missed a clause for deleting from the itemtypes table

4 months agofixed xpath issues with restore_itemtypes
Rogan Hamby [Wed, 3 Jun 2020 15:10:41 +0000]
fixed xpath issues with restore_itemtypes

4 months agoadded to kmig bookseller and budget support to import and export
Rogan Hamby [Tue, 2 Jun 2020 20:15:34 +0000]
added to kmig bookseller and budget support to import and export

4 months agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:23 +0000]
adding the start of base sql and marc functions for koha to mig-init

4 months agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:08 +0000]
adding the start of base sql and marc functions for koha to mig-init

4 months agobase staging tables for koha added for kmig.d/init
Rogan Hamby [Tue, 2 Jun 2020 13:42:49 +0000]
base staging tables for koha added for kmig.d/init

5 months agoreplace borrower_attributes with borrowerattributes for file name in mig-export
Rogan Hamby [Thu, 28 May 2020 17:46:35 +0000]
replace borrower_attributes with borrowerattributes for file name in mig-export

5 months agoadding borrower attributes to mig import/export
Rogan Hamby [Wed, 27 May 2020 20:33:51 +0000]
adding borrower attributes to mig import/export

5 months agoadding m_ for koha functions and an update_leader function
Rogan Hamby [Wed, 27 May 2020 15:52:37 +0000]
adding m_ for koha functions and an update_leader function

5 months agokmig import/export now support syncing reports
Rogan Hamby [Thu, 21 May 2020 20:58:28 +0000]
kmig import/export now support syncing reports

5 months agovarious enhacnements to emig bibstats including adding it to kmig
Rogan Hamby [Tue, 19 May 2020 20:16:03 +0000]
various enhacnements to emig bibstats including adding it to kmig

5 months agoadded profile for Destiny to mig bibstats
Rogan Hamby [Tue, 19 May 2020 17:21:33 +0000]
added profile for Destiny to mig bibstats

5 months agoadjust -test components of kohacatalog.com domains in kmig import
Rogan Hamby [Thu, 7 May 2020 14:41:01 +0000]
adjust -test components of kohacatalog.com domains in kmig import

5 months agoadd some new koha reports
Rogan Hamby [Tue, 5 May 2020 19:17:01 +0000]
add some new koha reports

5 months agochange default behavior for no --analyst tag
Rogan Hamby [Mon, 4 May 2020 19:33:36 +0000]
change default behavior for no --analyst tag

5 months agoset ->do('SET NAMES utf8mb4'); by default
Rogan Hamby [Mon, 4 May 2020 15:50:38 +0000]
set ->do('SET NAMES utf8mb4'); by default

5 months agomore robust versions of kmig import and export
Rogan Hamby [Mon, 4 May 2020 15:49:40 +0000]
more robust versions of kmig import and export

6 months agosimplify a few exports and add one for itemtypes
Rogan Hamby [Wed, 22 Apr 2020 19:10:20 +0000]
simplify a few exports and add one for itemtypes

6 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:34 +0000]
updated mig export to use xml and mig import supports libraries and preferences

6 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:22 +0000]
updated mig export to use xml and mig import supports libraries and preferences

6 months agoinitial version of mig-export added for kmig
Rogan Hamby [Fri, 17 Apr 2020 16:22:50 +0000]
initial version of mig-export added for kmig

6 months agounneeded variable declaration removed
Rogan Hamby [Thu, 16 Apr 2020 18:54:00 +0000]
unneeded variable declaration removed

6 months agoremoving no longer needed parameter
Rogan Hamby [Thu, 16 Apr 2020 18:51:43 +0000]
removing no longer needed parameter

6 months agodon't index x_count if we see it
Jason Etheridge [Thu, 16 Apr 2020 14:38:14 +0000]
don't index x_count if we see it

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agodefault charset and collate for csv2mysql
Jason Etheridge [Thu, 16 Apr 2020 14:36:45 +0000]
default charset and collate for csv2mysql

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agofirst cut of kmig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:48:16 +0000]
first cut of kmig-quick

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agoseed kmig-quick with emig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:47:29 +0000]
seed kmig-quick with emig-quick

6 months agoif we come across these, make them BIGINT. mysql/mariadb can't index TEXT
Jason Etheridge [Wed, 15 Apr 2020 20:32:46 +0000]
if we come across these, make them BIGINT. mysql/mariadb can't index TEXT

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agomake sure worksheet names do not go over 31 characters
Jason Etheridge [Wed, 15 Apr 2020 20:31:11 +0000]
make sure worksheet names do not go over 31 characters

6 months agosimplifying defaults a bit
Rogan Hamby [Wed, 15 Apr 2020 18:11:06 +0000]
simplifying defaults a bit

6 months agoadding kmig reporter
Rogan Hamby [Wed, 15 Apr 2020 18:09:17 +0000]
adding kmig reporter

6 months agowe don't need to pre-create Koha staging tables since mig link and mig stage can... kmig
Jason Etheridge [Fri, 10 Apr 2020 21:00:42 +0000]
we don't need to pre-create Koha staging tables since mig link and mig stage can do it

6 months agofirst cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent...
Jason Etheridge [Fri, 10 Apr 2020 21:00:12 +0000]
first cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent tables, since based on the naming convention we can vivicate them

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agoseed kmig-stage with emig-stage
Jason Etheridge [Fri, 10 Apr 2020 20:48:24 +0000]
seed kmig-stage with emig-stage

6 months agofirst cut of csv2mysql, mig-convert, and a needed tweak for mig-sql
Jason Etheridge [Fri, 10 Apr 2020 20:47:09 +0000]
first cut of csv2mysql, mig-convert, and a needed tweak for mig-sql

6 months agomove csv2mysql into the kmig hierarchy so we can better leverage KMig.pm
Jason Etheridge [Fri, 10 Apr 2020 20:03:57 +0000]
move csv2mysql into the kmig hierarchy so we can better leverage KMig.pm

6 months agoseed csv2mysql with csv2sql
Jason Etheridge [Fri, 10 Apr 2020 20:01:53 +0000]
seed csv2mysql with csv2sql

6 months agoseed kmig-convert with emig-convert
Jason Etheridge [Fri, 10 Apr 2020 19:53:43 +0000]
seed kmig-convert with emig-convert

6 months agofirst cut of kmig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:31:31 +0000]
first cut of kmig-unlink

6 months agoseed kmig-unlink with emig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:29:44 +0000]
seed kmig-unlink with emig-unlink

6 months agofirst cut of kmig-link
Jason Etheridge [Fri, 10 Apr 2020 19:29:18 +0000]
first cut of kmig-link

6 months agoseed kmig-link with emig-link
Jason Etheridge [Fri, 10 Apr 2020 19:21:48 +0000]
seed kmig-link with emig-link

6 months agomore path touchups
Jason Etheridge [Fri, 10 Apr 2020 19:20:37 +0000]
more path touchups

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agomig wrapper to kmig/emig
Jason Etheridge [Fri, 10 Apr 2020 18:44:58 +0000]
mig wrapper to kmig/emig

It won't handle first time setup; you'll need to call emig or kmig explicitly
until an environment is loaded.

Example:

    kmig env create demo
    kmig env use demo
    mig init
    mig add foo.txt etc

Also, the older ~/.mig environment directory, if used with the new mig, will
need to be moved or merged into ~/.emig, and the various *.env files ammended
with:

    export MIGCMD=emig

6 months agorewire to match the new naming scheme and layout
Jason Etheridge [Fri, 10 Apr 2020 18:28:17 +0000]
rewire to match the new naming scheme and layout

6 months agolet's not name these differently than the emig.d/ counterparts
Jason Etheridge [Fri, 10 Apr 2020 18:13:08 +0000]
let's not name these differently than the emig.d/ counterparts

6 months agotoward renaming mig to emig and tweaking the directory layout
Jason Etheridge [Fri, 10 Apr 2020 18:05:56 +0000]
toward renaming mig to emig and tweaking the directory layout