Discussion of NodeBB Updates



  • @ben_lubar wtf you guys wasted a Geforce GTX 78? in a forum server?



  • @sockpuppet7 this is my gaming PC. The forum server isn't running Wandows 10.


  • Grade A Premium Asshole

    @ben_lubar said in Discussion of NodeBB Updates:

    Why is the script not running faster?

    Network usage looks like it is maxed out for MilwaukeePC.


  • ♿ (Parody)

    @ben_lubar said in Discussion of NodeBB Updates:

    MongoDB, this script, and PostgreSQL are all running on the same SSD (D:). None of them have any OS-imposed limits on CPU, network, disk, or RAM usage.
    Why is the script not running faster?

    CPU + waiting on the other one to do something? It looks like two of the cores are working pretty hard.


  • Grade A Premium Asshole

    @sockpuppet7 said in Discussion of NodeBB Updates:

    @ben_lubar wtf you guys wasted a Geforce GTX 78? in a forum server?

    We are making @apapadimoulis pay for our cryptocurrency mining.

    We tried to get the forums to run on an ASIC, but Node is not ported to it yet.

    Yet.


  • Impossible Mission - B

    @pie_flavor said in Discussion of NodeBB Updates:

    @blakeyrat
    https://i.imgur.com/6pgFf88.png
    Hopefully I get a response soon.

    His response to this is to dodge the issue by saying that we made him an administrator of the site, and moderation is within the powers of that role. Which is :pendant:ically correct, but completely wrong in actual substance. We wanted him to have an admin role specifically for technical assistance, because we were well aware that this was beta-grade software and he was the lead developer. We never asked nor invited him to perform the functions of a moderator, and he didn't stop when we made it clear that that wasn't wanted.

    Go on. Ask me how I know that's what he's going to say...


  • Grade A Premium Asshole

    @masonwheeler said in Discussion of NodeBB Updates:

    Go on. Ask me how I know that's what he's going to say...

    Careful, don't violate any NDAs in the process.


  • kills Dumbledore

    @polygeekery shut up Wesley



  • @boomzilla said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    MongoDB, this script, and PostgreSQL are all running on the same SSD (D:). None of them have any OS-imposed limits on CPU, network, disk, or RAM usage.
    Why is the script not running faster?

    CPU + waiting on the other one to do something? It looks like two of the cores are working pretty hard.

    Does anyone know if I'm writing to this stream wrong?

    Ideally, I'd like to have at least one end of the stream running at all times.



  • @ben_lubar Lots of disk whatever an SSD does instead of seeking?



  • @sockpuppet7 1% usage is "lots"?



  • @ben_lubar that's 1% of it's maximum, right? In spinning disks small random writes would make much less than 100% of it's maximum throughput

    Databases will also do a lot of fsyncs

    IIRC you can disable fsync on commits on postgresql, and this helps when you're doing migrations like this one.


  • Grade A Premium Asshole

    @sockpuppet7 said in Discussion of NodeBB Updates:

    @ben_lubar that's 1% of it's maximum, right? In spinning disks small random writes would make much less than 100% of it's maximum throughput

    From the best I can tell, Win10 takes that in to account. 100% means 100% usage, not 100% of maximum throughput.


  • Trolleybus Mechanic

    @masonwheeler said in Discussion of NodeBB Updates:

    Go on. Ask me how I know that's what he's going to say...

    How do you know that's what he's going to say...?


  • :belt_onion:



  • 0_1516657705347_87d0e3db-647c-41d2-9e21-a8313d5a6c52-image.png

    Thanks PostgreSQL, that's what I wanted. Why have resources if nothing is going to use them up?


  • ♿ (Parody)

    @ben_lubar What did you change?



  • @boomzilla said in Discussion of NodeBB Updates:

    @ben_lubar What did you change?

    Nothing, it just got further into the script. Right now it's on the "go through the objects table with one column and split it into six tables" part.

    As I was writing this post, it started the "split import data into a seventh table" part



  • Ok, here's the Postgres conversion, split into two posts.

    Fun fact: the NodeJS pg module hangs forever if it tries to connect to a Windows PostgreSQL server with integrated authentication.

    PS D:\wtdwtf> node .\node_modules\@ben_lubar\nodebb-postgres-converter\bin\converter.js -t mongo -i 'mongodb://localhost/0' -o 'postgresql://Owner:hunter2@localhost/nodebb' -m 2047MB
    [2018-01-22 15:07:45.975] [LOG]   Counting objects...
    [2018-01-22 15:07:46.841] [LOG]   Create table objects: 47.116ms
    [2018-01-22 15:07:46.861] [LOG]   Attempting to copy 32809525 objects...
    [2018-01-22 15:07:51.557] [LOG]     0% - 99999 objects copied (1 skipped)
    [2018-01-22 15:07:56.310] [LOG]     0% - 199999 objects copied (1 skipped)
    [2018-01-22 15:08:01.082] [LOG]     0% - 299999 objects copied (1 skipped)
    [2018-01-22 15:08:05.876] [LOG]     1% - 399999 objects copied (1 skipped)
    [2018-01-22 15:08:10.651] [LOG]     1% - 499999 objects copied (1 skipped)
    [2018-01-22 15:08:15.374] [LOG]     1% - 599999 objects copied (1 skipped)
    [2018-01-22 15:08:20.080] [LOG]     2% - 699999 objects copied (1 skipped)
    [2018-01-22 15:08:24.787] [LOG]     2% - 799999 objects copied (1 skipped)
    [2018-01-22 15:08:29.628] [LOG]     2% - 899999 objects copied (1 skipped)
    [2018-01-22 15:08:34.435] [LOG]     3% - 999999 objects copied (1 skipped)
    [2018-01-22 15:08:39.171] [LOG]     3% - 1099999 objects copied (1 skipped)
    [2018-01-22 15:08:43.996] [LOG]     3% - 1199999 objects copied (1 skipped)
    [2018-01-22 15:08:49.026] [LOG]     3% - 1299999 objects copied (1 skipped)
    [2018-01-22 15:08:54.185] [LOG]     4% - 1399999 objects copied (1 skipped)
    [2018-01-22 15:08:59.152] [LOG]     4% - 1499999 objects copied (1 skipped)
    [2018-01-22 15:09:04.356] [LOG]     4% - 1599999 objects copied (1 skipped)
    [2018-01-22 15:09:09.260] [LOG]     5% - 1699999 objects copied (1 skipped)
    [2018-01-22 15:09:14.057] [LOG]     5% - 1799999 objects copied (1 skipped)
    [2018-01-22 15:09:18.722] [LOG]     5% - 1899999 objects copied (1 skipped)
    [2018-01-22 15:09:23.396] [LOG]     6% - 1999999 objects copied (1 skipped)
    [2018-01-22 15:09:28.181] [LOG]     6% - 2099999 objects copied (1 skipped)
    [2018-01-22 15:09:33.408] [LOG]     6% - 2199999 objects copied (1 skipped)
    [2018-01-22 15:09:38.583] [LOG]     7% - 2299999 objects copied (1 skipped)
    [2018-01-22 15:09:43.428] [LOG]     7% - 2399999 objects copied (1 skipped)
    [2018-01-22 15:09:48.155] [LOG]     7% - 2499999 objects copied (1 skipped)
    [2018-01-22 15:09:52.017] [LOG]     7% - 2581566 objects copied (18434 skipped)
    [2018-01-22 15:09:57.229] [LOG]     8% - 2673647 objects copied (26353 skipped)
    [2018-01-22 15:10:02.435] [LOG]     8% - 2773647 objects copied (26353 skipped)
    [2018-01-22 15:10:07.504] [LOG]     8% - 2873647 objects copied (26353 skipped)
    [2018-01-22 15:10:12.817] [LOG]     9% - 2973647 objects copied (26353 skipped)
    [2018-01-22 15:10:18.153] [LOG]     9% - 3073588 objects copied (26412 skipped)
    [2018-01-22 15:10:23.393] [LOG]     9% - 3173183 objects copied (26817 skipped)
    [2018-01-22 15:10:28.711] [LOG]    10% - 3273183 objects copied (26817 skipped)
    [2018-01-22 15:10:34.070] [LOG]    10% - 3373183 objects copied (26817 skipped)
    [2018-01-22 15:10:39.486] [LOG]    10% - 3473183 objects copied (26817 skipped)
    [2018-01-22 15:10:45.387] [LOG]    10% - 3573183 objects copied (26817 skipped)
    [2018-01-22 15:10:51.182] [LOG]    11% - 3673183 objects copied (26817 skipped)
    [2018-01-22 15:10:56.981] [LOG]    11% - 3773183 objects copied (26817 skipped)
    [2018-01-22 15:11:02.958] [LOG]    11% - 3873183 objects copied (26817 skipped)
    [2018-01-22 15:11:09.606] [LOG]    12% - 3973183 objects copied (26817 skipped)
    [2018-01-22 15:11:15.834] [LOG]    12% - 4073183 objects copied (26817 skipped)
    [2018-01-22 15:11:21.868] [LOG]    12% - 4173183 objects copied (26817 skipped)
    [2018-01-22 15:11:28.026] [LOG]    13% - 4273183 objects copied (26817 skipped)
    [2018-01-22 15:11:34.572] [LOG]    13% - 4373183 objects copied (26817 skipped)
    [2018-01-22 15:11:40.644] [LOG]    13% - 4473183 objects copied (26817 skipped)
    [2018-01-22 15:11:46.930] [LOG]    14% - 4573183 objects copied (26817 skipped)
    [2018-01-22 15:11:52.647] [LOG]    14% - 4673183 objects copied (26817 skipped)
    [2018-01-22 15:11:58.269] [LOG]    14% - 4773183 objects copied (26817 skipped)
    [2018-01-22 15:12:04.110] [LOG]    14% - 4873183 objects copied (26817 skipped)
    [2018-01-22 15:12:09.857] [LOG]    15% - 4973183 objects copied (26817 skipped)
    [2018-01-22 15:12:15.846] [LOG]    15% - 5073183 objects copied (26817 skipped)
    [2018-01-22 15:12:21.641] [LOG]    15% - 5173183 objects copied (26817 skipped)
    [2018-01-22 15:12:26.921] [LOG]    16% - 5273183 objects copied (26817 skipped)
    [2018-01-22 15:12:32.398] [LOG]    16% - 5373183 objects copied (26817 skipped)
    [2018-01-22 15:12:37.883] [LOG]    16% - 5473183 objects copied (26817 skipped)
    [2018-01-22 15:12:43.508] [LOG]    17% - 5573183 objects copied (26817 skipped)
    [2018-01-22 15:12:49.393] [LOG]    17% - 5673183 objects copied (26817 skipped)
    [2018-01-22 15:12:55.255] [LOG]    17% - 5773183 objects copied (26817 skipped)
    [2018-01-22 15:13:01.094] [LOG]    17% - 5873183 objects copied (26817 skipped)
    [2018-01-22 15:13:06.717] [LOG]    18% - 5973183 objects copied (26817 skipped)
    [2018-01-22 15:13:12.385] [LOG]    18% - 6073183 objects copied (26817 skipped)
    [2018-01-22 15:13:18.284] [LOG]    18% - 6173183 objects copied (26817 skipped)
    [2018-01-22 15:13:24.250] [LOG]    19% - 6273183 objects copied (26817 skipped)
    [2018-01-22 15:13:30.432] [LOG]    19% - 6373183 objects copied (26817 skipped)
    [2018-01-22 15:13:36.371] [LOG]    19% - 6473183 objects copied (26817 skipped)
    [2018-01-22 15:13:42.629] [LOG]    20% - 6573183 objects copied (26817 skipped)
    [2018-01-22 15:13:48.733] [LOG]    20% - 6673183 objects copied (26817 skipped)
    [2018-01-22 15:13:55.007] [LOG]    20% - 6773183 objects copied (26817 skipped)
    [2018-01-22 15:14:01.125] [LOG]    21% - 6873183 objects copied (26817 skipped)
    [2018-01-22 15:14:06.898] [LOG]    21% - 6973183 objects copied (26817 skipped)
    [2018-01-22 15:14:12.937] [LOG]    21% - 7073183 objects copied (26817 skipped)
    [2018-01-22 15:14:19.019] [LOG]    21% - 7173183 objects copied (26817 skipped)
    [2018-01-22 15:14:24.645] [LOG]    22% - 7273183 objects copied (26817 skipped)
    [2018-01-22 15:14:30.610] [LOG]    22% - 7373183 objects copied (26817 skipped)
    [2018-01-22 15:14:36.983] [LOG]    22% - 7473183 objects copied (26817 skipped)
    [2018-01-22 15:14:42.806] [LOG]    23% - 7573183 objects copied (26817 skipped)
    [2018-01-22 15:14:48.936] [LOG]    23% - 7673183 objects copied (26817 skipped)
    [2018-01-22 15:14:55.288] [LOG]    23% - 7773183 objects copied (26817 skipped)
    [2018-01-22 15:15:02.006] [LOG]    24% - 7873183 objects copied (26817 skipped)
    [2018-01-22 15:15:08.692] [LOG]    24% - 7973183 objects copied (26817 skipped)
    [2018-01-22 15:15:14.645] [LOG]    24% - 8073183 objects copied (26817 skipped)
    [2018-01-22 15:15:20.563] [LOG]    24% - 8173183 objects copied (26817 skipped)
    [2018-01-22 15:15:27.076] [LOG]    25% - 8273183 objects copied (26817 skipped)
    [2018-01-22 15:15:33.692] [LOG]    25% - 8373183 objects copied (26817 skipped)
    [2018-01-22 15:15:40.471] [LOG]    25% - 8473183 objects copied (26817 skipped)
    [2018-01-22 15:15:47.316] [LOG]    26% - 8573183 objects copied (26817 skipped)
    [2018-01-22 15:15:53.279] [LOG]    26% - 8673183 objects copied (26817 skipped)
    [2018-01-22 15:15:58.843] [LOG]    26% - 8773183 objects copied (26817 skipped)
    [2018-01-22 15:16:04.714] [LOG]    27% - 8873183 objects copied (26817 skipped)
    [2018-01-22 15:16:10.728] [LOG]    27% - 8973183 objects copied (26817 skipped)
    [2018-01-22 15:16:16.411] [LOG]    27% - 9073183 objects copied (26817 skipped)
    [2018-01-22 15:16:22.379] [LOG]    28% - 9173183 objects copied (26817 skipped)
    [2018-01-22 15:16:28.061] [LOG]    28% - 9273183 objects copied (26817 skipped)
    [2018-01-22 15:16:33.687] [LOG]    28% - 9373183 objects copied (26817 skipped)
    [2018-01-22 15:16:39.405] [LOG]    28% - 9473183 objects copied (26817 skipped)
    [2018-01-22 15:16:44.991] [LOG]    29% - 9573183 objects copied (26817 skipped)
    [2018-01-22 15:16:50.214] [LOG]    29% - 9673183 objects copied (26817 skipped)
    [2018-01-22 15:16:55.093] [LOG]    29% - 9773183 objects copied (26817 skipped)
    [2018-01-22 15:16:59.914] [LOG]    30% - 9873183 objects copied (26817 skipped)
    [2018-01-22 15:17:04.795] [LOG]    30% - 9973183 objects copied (26817 skipped)
    [2018-01-22 15:17:09.684] [LOG]    30% - 10073183 objects copied (26817 skipped)
    [2018-01-22 15:17:14.495] [LOG]    31% - 10173183 objects copied (26817 skipped)
    [2018-01-22 15:17:19.556] [LOG]    31% - 10273183 objects copied (26817 skipped)
    [2018-01-22 15:17:24.542] [LOG]    31% - 10373183 objects copied (26817 skipped)
    [2018-01-22 15:17:29.681] [LOG]    32% - 10473183 objects copied (26817 skipped)
    [2018-01-22 15:17:35.015] [LOG]    32% - 10573183 objects copied (26817 skipped)
    [2018-01-22 15:17:40.027] [LOG]    32% - 10673183 objects copied (26817 skipped)
    [2018-01-22 15:17:44.813] [LOG]    32% - 10773183 objects copied (26817 skipped)
    [2018-01-22 15:17:49.682] [LOG]    33% - 10873183 objects copied (26817 skipped)
    [2018-01-22 15:17:54.570] [LOG]    33% - 10973183 objects copied (26817 skipped)
    [2018-01-22 15:17:59.385] [LOG]    33% - 11073183 objects copied (26817 skipped)
    [2018-01-22 15:18:04.301] [LOG]    34% - 11173183 objects copied (26817 skipped)
    [2018-01-22 15:18:09.121] [LOG]    34% - 11273183 objects copied (26817 skipped)
    [2018-01-22 15:18:14.024] [LOG]    34% - 11373183 objects copied (26817 skipped)
    [2018-01-22 15:18:18.917] [LOG]    35% - 11473183 objects copied (26817 skipped)
    [2018-01-22 15:18:24.027] [LOG]    35% - 11573183 objects copied (26817 skipped)
    [2018-01-22 15:18:28.998] [LOG]    35% - 11673183 objects copied (26817 skipped)
    [2018-01-22 15:18:33.799] [LOG]    35% - 11773183 objects copied (26817 skipped)
    [2018-01-22 15:18:38.581] [LOG]    36% - 11873183 objects copied (26817 skipped)
    [2018-01-22 15:18:43.367] [LOG]    36% - 11973183 objects copied (26817 skipped)
    [2018-01-22 15:18:48.153] [LOG]    36% - 12073183 objects copied (26817 skipped)
    [2018-01-22 15:18:52.925] [LOG]    37% - 12173183 objects copied (26817 skipped)
    [2018-01-22 15:18:57.702] [LOG]    37% - 12273183 objects copied (26817 skipped)
    [2018-01-22 15:19:02.490] [LOG]    37% - 12373183 objects copied (26817 skipped)
    [2018-01-22 15:19:07.288] [LOG]    38% - 12473183 objects copied (26817 skipped)
    [2018-01-22 15:19:12.114] [LOG]    38% - 12573183 objects copied (26817 skipped)
    [2018-01-22 15:19:17.023] [LOG]    38% - 12673183 objects copied (26817 skipped)
    [2018-01-22 15:19:21.942] [LOG]    39% - 12773183 objects copied (26817 skipped)
    [2018-01-22 15:19:26.862] [LOG]    39% - 12873183 objects copied (26817 skipped)
    [2018-01-22 15:19:32.094] [LOG]    39% - 12973183 objects copied (26817 skipped)
    [2018-01-22 15:19:36.889] [LOG]    39% - 13073183 objects copied (26817 skipped)
    [2018-01-22 15:19:41.899] [LOG]    40% - 13173183 objects copied (26817 skipped)
    [2018-01-22 15:19:46.975] [LOG]    40% - 13273183 objects copied (26817 skipped)
    [2018-01-22 15:19:52.135] [LOG]    40% - 13373183 objects copied (26817 skipped)
    [2018-01-22 15:19:57.023] [LOG]    41% - 13473183 objects copied (26817 skipped)
    [2018-01-22 15:20:02.329] [LOG]    41% - 13573183 objects copied (26817 skipped)
    [2018-01-22 15:20:07.582] [LOG]    41% - 13673183 objects copied (26817 skipped)
    [2018-01-22 15:20:12.455] [LOG]    42% - 13773183 objects copied (26817 skipped)
    [2018-01-22 15:20:17.477] [LOG]    42% - 13873183 objects copied (26817 skipped)
    [2018-01-22 15:20:22.452] [LOG]    42% - 13973183 objects copied (26817 skipped)
    [2018-01-22 15:20:27.190] [LOG]    42% - 14073183 objects copied (26817 skipped)
    [2018-01-22 15:20:32.064] [LOG]    43% - 14173183 objects copied (26817 skipped)
    [2018-01-22 15:20:37.098] [LOG]    43% - 14273183 objects copied (26817 skipped)
    [2018-01-22 15:20:41.998] [LOG]    43% - 14373183 objects copied (26817 skipped)
    [2018-01-22 15:20:46.858] [LOG]    44% - 14473183 objects copied (26817 skipped)
    [2018-01-22 15:20:51.822] [LOG]    44% - 14573183 objects copied (26817 skipped)
    [2018-01-22 15:20:56.832] [LOG]    44% - 14673183 objects copied (26817 skipped)
    [2018-01-22 15:21:01.866] [LOG]    45% - 14773183 objects copied (26817 skipped)
    [2018-01-22 15:21:06.725] [LOG]    45% - 14873183 objects copied (26817 skipped)
    [2018-01-22 15:21:11.694] [LOG]    45% - 14973183 objects copied (26817 skipped)
    [2018-01-22 15:21:16.492] [LOG]    46% - 15073183 objects copied (26817 skipped)
    [2018-01-22 15:21:21.382] [LOG]    46% - 15173183 objects copied (26817 skipped)
    [2018-01-22 15:21:26.278] [LOG]    46% - 15273183 objects copied (26817 skipped)
    [2018-01-22 15:21:31.213] [LOG]    46% - 15373183 objects copied (26817 skipped)
    [2018-01-22 15:21:36.026] [LOG]    47% - 15473183 objects copied (26817 skipped)
    [2018-01-22 15:21:41.012] [LOG]    47% - 15573183 objects copied (26817 skipped)
    [2018-01-22 15:21:46.038] [LOG]    47% - 15673183 objects copied (26817 skipped)
    [2018-01-22 15:21:50.858] [LOG]    48% - 15773183 objects copied (26817 skipped)
    [2018-01-22 15:21:55.716] [LOG]    48% - 15873183 objects copied (26817 skipped)
    [2018-01-22 15:22:00.452] [LOG]    48% - 15973183 objects copied (26817 skipped)
    [2018-01-22 15:22:05.468] [LOG]    49% - 16073183 objects copied (26817 skipped)
    [2018-01-22 15:22:10.251] [LOG]    49% - 16173183 objects copied (26817 skipped)
    [2018-01-22 15:22:15.203] [LOG]    49% - 16273183 objects copied (26817 skipped)
    [2018-01-22 15:22:20.088] [LOG]    49% - 16373183 objects copied (26817 skipped)
    


  • [2018-01-22 15:22:24.810] [LOG]    50% - 16473183 objects copied (26817 skipped)
    [2018-01-22 15:22:29.542] [LOG]    50% - 16573183 objects copied (26817 skipped)
    [2018-01-22 15:22:34.358] [LOG]    50% - 16673183 objects copied (26817 skipped)
    [2018-01-22 15:22:39.158] [LOG]    51% - 16773183 objects copied (26817 skipped)
    [2018-01-22 15:22:43.969] [LOG]    51% - 16873183 objects copied (26817 skipped)
    [2018-01-22 15:22:48.991] [LOG]    51% - 16973183 objects copied (26817 skipped)
    [2018-01-22 15:22:54.133] [LOG]    52% - 17073183 objects copied (26817 skipped)
    [2018-01-22 15:22:58.968] [LOG]    52% - 17173183 objects copied (26817 skipped)
    [2018-01-22 15:23:03.745] [LOG]    52% - 17273183 objects copied (26817 skipped)
    [2018-01-22 15:23:08.497] [LOG]    53% - 17373183 objects copied (26817 skipped)
    [2018-01-22 15:23:13.294] [LOG]    53% - 17473183 objects copied (26817 skipped)
    [2018-01-22 15:23:18.022] [LOG]    53% - 17573183 objects copied (26817 skipped)
    [2018-01-22 15:23:22.755] [LOG]    53% - 17673183 objects copied (26817 skipped)
    [2018-01-22 15:23:27.531] [LOG]    54% - 17773183 objects copied (26817 skipped)
    [2018-01-22 15:23:32.579] [LOG]    54% - 17873183 objects copied (26817 skipped)
    [2018-01-22 15:23:37.583] [LOG]    54% - 17973183 objects copied (26817 skipped)
    [2018-01-22 15:23:42.335] [LOG]    55% - 18073183 objects copied (26817 skipped)
    [2018-01-22 15:23:47.089] [LOG]    55% - 18173183 objects copied (26817 skipped)
    [2018-01-22 15:23:51.770] [LOG]    55% - 18273183 objects copied (26817 skipped)
    [2018-01-22 15:23:56.409] [LOG]    56% - 18373183 objects copied (26817 skipped)
    [2018-01-22 15:24:00.885] [LOG]    56% - 18473183 objects copied (26817 skipped)
    [2018-01-22 15:24:05.308] [LOG]    56% - 18573183 objects copied (26817 skipped)
    [2018-01-22 15:24:09.742] [LOG]    56% - 18673183 objects copied (26817 skipped)
    [2018-01-22 15:24:14.284] [LOG]    57% - 18773183 objects copied (26817 skipped)
    [2018-01-22 15:24:18.768] [LOG]    57% - 18873183 objects copied (26817 skipped)
    [2018-01-22 15:24:23.253] [LOG]    57% - 18973183 objects copied (26817 skipped)
    [2018-01-22 15:24:27.731] [LOG]    58% - 19073183 objects copied (26817 skipped)
    [2018-01-22 15:24:32.209] [LOG]    58% - 19173183 objects copied (26817 skipped)
    [2018-01-22 15:24:36.694] [LOG]    58% - 19273183 objects copied (26817 skipped)
    [2018-01-22 15:24:41.125] [LOG]    59% - 19373183 objects copied (26817 skipped)
    [2018-01-22 15:24:45.602] [LOG]    59% - 19473183 objects copied (26817 skipped)
    [2018-01-22 15:24:50.048] [LOG]    59% - 19573183 objects copied (26817 skipped)
    [2018-01-22 15:24:54.509] [LOG]    60% - 19673183 objects copied (26817 skipped)
    [2018-01-22 15:24:59.000] [LOG]    60% - 19773183 objects copied (26817 skipped)
    [2018-01-22 15:25:03.950] [LOG]    60% - 19873183 objects copied (26817 skipped)
    [2018-01-22 15:25:08.524] [LOG]    60% - 19973183 objects copied (26817 skipped)
    [2018-01-22 15:25:13.055] [LOG]    61% - 20073183 objects copied (26817 skipped)
    [2018-01-22 15:25:17.792] [LOG]    61% - 20173183 objects copied (26817 skipped)
    [2018-01-22 15:25:22.344] [LOG]    61% - 20273183 objects copied (26817 skipped)
    [2018-01-22 15:25:26.837] [LOG]    62% - 20373183 objects copied (26817 skipped)
    [2018-01-22 15:25:31.567] [LOG]    62% - 20473183 objects copied (26817 skipped)
    [2018-01-22 15:25:36.272] [LOG]    62% - 20573183 objects copied (26817 skipped)
    [2018-01-22 15:25:40.890] [LOG]    63% - 20673183 objects copied (26817 skipped)
    [2018-01-22 15:25:45.463] [LOG]    63% - 20773183 objects copied (26817 skipped)
    [2018-01-22 15:25:49.876] [LOG]    63% - 20873183 objects copied (26817 skipped)
    [2018-01-22 15:25:54.820] [LOG]    64% - 20972773 objects copied (27227 skipped)
    [2018-01-22 15:26:00.185] [LOG]    64% - 21072773 objects copied (27227 skipped)
    [2018-01-22 15:26:05.002] [LOG]    64% - 21172713 objects copied (27287 skipped)
    [2018-01-22 15:26:09.968] [LOG]    64% - 21272637 objects copied (27363 skipped)
    [2018-01-22 15:26:14.345] [LOG]    65% - 21366844 objects copied (33156 skipped)
    [2018-01-22 15:26:18.255] [LOG]    65% - 21452469 objects copied (47531 skipped)
    [2018-01-22 15:26:22.926] [LOG]    65% - 21552447 objects copied (47553 skipped)
    [2018-01-22 15:26:27.659] [LOG]    66% - 21652414 objects copied (47586 skipped)
    [2018-01-22 15:26:32.356] [LOG]    66% - 21752395 objects copied (47605 skipped)
    [2018-01-22 15:26:37.015] [LOG]    66% - 21852384 objects copied (47616 skipped)
    [2018-01-22 15:26:41.774] [LOG]    67% - 21952384 objects copied (47616 skipped)
    [2018-01-22 15:26:46.276] [LOG]    67% - 22052374 objects copied (47626 skipped)
    [2018-01-22 15:26:50.954] [LOG]    67% - 22152348 objects copied (47652 skipped)
    [2018-01-22 15:26:55.572] [LOG]    67% - 22252332 objects copied (47668 skipped)
    [2018-01-22 15:27:00.347] [LOG]    68% - 22352318 objects copied (47682 skipped)
    [2018-01-22 15:27:05.015] [LOG]    68% - 22452299 objects copied (47701 skipped)
    [2018-01-22 15:27:09.618] [LOG]    68% - 22552261 objects copied (47739 skipped)
    [2018-01-22 15:27:14.417] [LOG]    69% - 22652228 objects copied (47772 skipped)
    [2018-01-22 15:27:19.027] [LOG]    69% - 22752208 objects copied (47792 skipped)
    [2018-01-22 15:27:23.619] [LOG]    69% - 22852170 objects copied (47830 skipped)
    [2018-01-22 15:27:28.228] [LOG]    70% - 22952144 objects copied (47856 skipped)
    [2018-01-22 15:27:33.104] [LOG]    70% - 23052122 objects copied (47878 skipped)
    [2018-01-22 15:27:37.771] [LOG]    70% - 23152098 objects copied (47902 skipped)
    [2018-01-22 15:27:42.404] [LOG]    71% - 23252077 objects copied (47923 skipped)
    [2018-01-22 15:27:47.153] [LOG]    71% - 23352064 objects copied (47936 skipped)
    [2018-01-22 15:27:51.788] [LOG]    71% - 23452045 objects copied (47955 skipped)
    [2018-01-22 15:27:56.486] [LOG]    71% - 23552029 objects copied (47971 skipped)
    [2018-01-22 15:28:01.310] [LOG]    72% - 23652015 objects copied (47985 skipped)
    [2018-01-22 15:28:06.032] [LOG]    72% - 23752008 objects copied (47992 skipped)
    [2018-01-22 15:28:10.824] [LOG]    72% - 23851977 objects copied (48023 skipped)
    [2018-01-22 15:28:15.730] [LOG]    73% - 23951969 objects copied (48031 skipped)
    [2018-01-22 15:28:20.601] [LOG]    73% - 24051954 objects copied (48046 skipped)
    [2018-01-22 15:28:25.764] [LOG]    73% - 24151943 objects copied (48057 skipped)
    [2018-01-22 15:28:30.448] [LOG]    74% - 24251927 objects copied (48073 skipped)
    [2018-01-22 15:28:35.105] [LOG]    74% - 24351914 objects copied (48086 skipped)
    [2018-01-22 15:28:39.891] [LOG]    74% - 24451897 objects copied (48103 skipped)
    [2018-01-22 15:28:44.527] [LOG]    74% - 24551894 objects copied (48106 skipped)
    [2018-01-22 15:28:49.208] [LOG]    75% - 24651894 objects copied (48106 skipped)
    [2018-01-22 15:28:53.783] [LOG]    75% - 24751894 objects copied (48106 skipped)
    [2018-01-22 15:28:58.344] [LOG]    75% - 24851894 objects copied (48106 skipped)
    [2018-01-22 15:29:02.861] [LOG]    76% - 24951894 objects copied (48106 skipped)
    [2018-01-22 15:29:07.403] [LOG]    76% - 25051894 objects copied (48106 skipped)
    [2018-01-22 15:29:11.878] [LOG]    76% - 25151894 objects copied (48106 skipped)
    [2018-01-22 15:29:16.532] [LOG]    77% - 25251887 objects copied (48113 skipped)
    [2018-01-22 15:29:21.238] [LOG]    77% - 25351874 objects copied (48126 skipped)
    [2018-01-22 15:29:26.310] [LOG]    77% - 25451871 objects copied (48129 skipped)
    [2018-01-22 15:29:31.362] [LOG]    78% - 25551853 objects copied (48147 skipped)
    [2018-01-22 15:29:36.574] [LOG]    78% - 25651840 objects copied (48160 skipped)
    [2018-01-22 15:29:41.552] [LOG]    78% - 25751829 objects copied (48171 skipped)
    [2018-01-22 15:29:46.688] [LOG]    78% - 25851812 objects copied (48188 skipped)
    [2018-01-22 15:29:51.544] [LOG]    79% - 25951797 objects copied (48203 skipped)
    [2018-01-22 15:29:56.324] [LOG]    79% - 26051795 objects copied (48205 skipped)
    [2018-01-22 15:30:01.070] [LOG]    79% - 26151795 objects copied (48205 skipped)
    [2018-01-22 15:30:05.930] [LOG]    80% - 26251795 objects copied (48205 skipped)
    [2018-01-22 15:30:10.573] [LOG]    80% - 26351795 objects copied (48205 skipped)
    [2018-01-22 15:30:15.264] [LOG]    80% - 26451795 objects copied (48205 skipped)
    [2018-01-22 15:30:19.945] [LOG]    81% - 26551795 objects copied (48205 skipped)
    [2018-01-22 15:30:25.047] [LOG]    81% - 26651795 objects copied (48205 skipped)
    [2018-01-22 15:30:30.085] [LOG]    81% - 26751795 objects copied (48205 skipped)
    [2018-01-22 15:30:35.705] [LOG]    81% - 26851795 objects copied (48205 skipped)
    [2018-01-22 15:30:40.551] [LOG]    82% - 26951795 objects copied (48205 skipped)
    [2018-01-22 15:30:45.270] [LOG]    82% - 27051795 objects copied (48205 skipped)
    [2018-01-22 15:30:49.984] [LOG]    82% - 27151795 objects copied (48205 skipped)
    [2018-01-22 15:30:54.675] [LOG]    83% - 27251795 objects copied (48205 skipped)
    [2018-01-22 15:30:59.363] [LOG]    83% - 27351795 objects copied (48205 skipped)
    [2018-01-22 15:31:04.152] [LOG]    83% - 27451795 objects copied (48205 skipped)
    [2018-01-22 15:31:08.879] [LOG]    84% - 27551795 objects copied (48205 skipped)
    [2018-01-22 15:31:13.677] [LOG]    84% - 27651795 objects copied (48205 skipped)
    [2018-01-22 15:31:17.985] [LOG]    84% - 27751795 objects copied (48205 skipped)
    [2018-01-22 15:31:22.380] [LOG]    85% - 27851795 objects copied (48205 skipped)
    [2018-01-22 15:31:26.777] [LOG]    85% - 27951795 objects copied (48205 skipped)
    [2018-01-22 15:31:31.141] [LOG]    85% - 28051795 objects copied (48205 skipped)
    [2018-01-22 15:31:35.583] [LOG]    85% - 28151795 objects copied (48205 skipped)
    [2018-01-22 15:31:40.476] [LOG]    86% - 28251795 objects copied (48205 skipped)
    [2018-01-22 15:31:44.918] [LOG]    86% - 28351795 objects copied (48205 skipped)
    [2018-01-22 15:31:49.339] [LOG]    86% - 28451795 objects copied (48205 skipped)
    [2018-01-22 15:31:53.763] [LOG]    87% - 28551795 objects copied (48205 skipped)
    [2018-01-22 15:31:58.178] [LOG]    87% - 28651795 objects copied (48205 skipped)
    [2018-01-22 15:32:02.512] [LOG]    87% - 28751795 objects copied (48205 skipped)
    [2018-01-22 15:32:06.955] [LOG]    88% - 28851795 objects copied (48205 skipped)
    [2018-01-22 15:32:11.625] [LOG]    88% - 28951795 objects copied (48205 skipped)
    [2018-01-22 15:32:16.236] [LOG]    88% - 29051795 objects copied (48205 skipped)
    [2018-01-22 15:32:20.821] [LOG]    88% - 29151795 objects copied (48205 skipped)
    [2018-01-22 15:32:25.446] [LOG]    89% - 29251795 objects copied (48205 skipped)
    [2018-01-22 15:32:30.137] [LOG]    89% - 29351795 objects copied (48205 skipped)
    [2018-01-22 15:32:34.913] [LOG]    89% - 29451795 objects copied (48205 skipped)
    [2018-01-22 15:32:39.864] [LOG]    90% - 29551795 objects copied (48205 skipped)
    [2018-01-22 15:32:44.753] [LOG]    90% - 29651795 objects copied (48205 skipped)
    [2018-01-22 15:32:49.510] [LOG]    90% - 29751795 objects copied (48205 skipped)
    [2018-01-22 15:32:54.267] [LOG]    91% - 29851795 objects copied (48205 skipped)
    [2018-01-22 15:32:59.171] [LOG]    91% - 29951795 objects copied (48205 skipped)
    [2018-01-22 15:33:03.787] [LOG]    91% - 30051795 objects copied (48205 skipped)
    [2018-01-22 15:33:08.638] [LOG]    92% - 30151795 objects copied (48205 skipped)
    [2018-01-22 15:33:13.552] [LOG]    92% - 30251795 objects copied (48205 skipped)
    [2018-01-22 15:33:18.272] [LOG]    92% - 30351795 objects copied (48205 skipped)
    [2018-01-22 15:33:23.041] [LOG]    92% - 30451795 objects copied (48205 skipped)
    [2018-01-22 15:33:27.657] [LOG]    93% - 30551795 objects copied (48205 skipped)
    [2018-01-22 15:33:32.630] [LOG]    93% - 30651795 objects copied (48205 skipped)
    [2018-01-22 15:33:37.484] [LOG]    93% - 30751795 objects copied (48205 skipped)
    [2018-01-22 15:33:42.278] [LOG]    94% - 30851795 objects copied (48205 skipped)
    [2018-01-22 15:33:47.136] [LOG]    94% - 30951795 objects copied (48205 skipped)
    [2018-01-22 15:33:52.371] [LOG]    94% - 31051795 objects copied (48205 skipped)
    [2018-01-22 15:33:57.309] [LOG]    95% - 31151795 objects copied (48205 skipped)
    [2018-01-22 15:34:03.623] [LOG]    95% - 31251795 objects copied (48205 skipped)
    [2018-01-22 15:34:09.958] [LOG]    95% - 31351795 objects copied (48205 skipped)
    [2018-01-22 15:34:15.866] [LOG]    96% - 31451795 objects copied (48205 skipped)
    [2018-01-22 15:34:21.736] [LOG]    96% - 31551795 objects copied (48205 skipped)
    [2018-01-22 15:34:27.355] [LOG]    96% - 31651795 objects copied (48205 skipped)
    [2018-01-22 15:34:33.210] [LOG]    96% - 31751795 objects copied (48205 skipped)
    [2018-01-22 15:34:39.018] [LOG]    97% - 31851795 objects copied (48205 skipped)
    [2018-01-22 15:34:44.549] [LOG]    97% - 31951795 objects copied (48205 skipped)
    [2018-01-22 15:34:50.328] [LOG]    97% - 32051795 objects copied (48205 skipped)
    [2018-01-22 15:34:55.786] [LOG]    98% - 32151795 objects copied (48205 skipped)
    [2018-01-22 15:35:01.199] [LOG]    98% - 32251795 objects copied (48205 skipped)
    [2018-01-22 15:35:06.275] [LOG]    98% - 32351795 objects copied (48205 skipped)
    [2018-01-22 15:35:10.903] [LOG]    99% - 32451795 objects copied (48205 skipped)
    [2018-01-22 15:35:15.812] [LOG]    99% - 32551795 objects copied (48205 skipped)
    [2018-01-22 15:35:20.780] [LOG]    99% - 32651795 objects copied (48205 skipped)
    [2018-01-22 15:35:25.814] [LOG]    99% - 32751795 objects copied (48205 skipped)
    [2018-01-22 15:35:26.606] [LOG]   Copy: 1659853.216ms
    [2018-01-22 15:36:18.997] [LOG]   Create index on expireAt: 52174.780ms
    [2018-01-22 15:37:08.408] [LOG]   Create unique index on key: 101618.709ms
    [2018-01-22 15:39:21.728] [LOG]   Create index on key__score: 235126.836ms
    [2018-01-22 15:40:15.026] [LOG]   Create unique index on key__value: 288241.430ms
    [2018-01-22 15:40:15.029] [LOG]   Index: 288429.284ms
    [2018-01-22 15:40:15.034] [LOG]   [DB] analyzing "public.objects"
    [2018-01-22 15:40:17.670] [LOG]   [DB] "objects": scanned 30000 of 952986 pages, containing 1033614 live rows and 0 dead rows; 30000 rows in sample, 32763608 estimated total rows
    [2018-01-22 15:40:18.117] [LOG]   Analyze objects: 3086.287ms
    [2018-01-22 15:40:18.119] [LOG]   Analyze: 3088.375ms
    [2018-01-22 15:40:18.163] [LOG]   Create type legacy_object_type: 18.787ms
    [2018-01-22 15:40:18.171] [LOG]   Create table legacy_object: 5.131ms
    [2018-01-22 15:41:56.383] [LOG]   Insert into legacy_object (zset): 98214.468ms
    [2018-01-22 15:43:17.906] [LOG]   Insert into legacy_object (string, set, list, hash): 81522.509ms
    [2018-01-22 15:44:06.429] [LOG]   Add primary key to legacy_object: 48521.196ms
    [2018-01-22 15:45:01.030] [LOG]   Create unique index on key__type: 54601.869ms
    [2018-01-22 15:45:03.959] [LOG]   Create index on expireAt: 2927.804ms
    [2018-01-22 15:45:09.921] [LOG]   Create temporary index on type: 5960.565ms
    [2018-01-22 15:45:09.924] [LOG]   Objects: 291788.629ms
    [2018-01-22 15:45:09.943] [LOG]   Create table legacy_hash: 17.087ms
    [2018-01-22 15:45:09.950] [LOG]   Create table legacy_zset: 5.510ms
    [2018-01-22 15:45:09.957] [LOG]   Create table legacy_set: 5.821ms
    [2018-01-22 15:45:09.965] [LOG]   Create table legacy_list: 5.708ms
    [2018-01-22 15:45:09.974] [LOG]   Create table legacy_string: 7.651ms
    [2018-01-22 15:45:10.180] [LOG]   Insert into legacy_list: 12.751ms
    [2018-01-22 15:47:06.054] [LOG]   Insert into legacy_string: 115829.840ms
    [2018-01-22 15:48:26.607] [LOG]   Insert into legacy_set: 196444.257ms
    [2018-01-22 15:49:47.295] [LOG]   Insert into legacy_zset: 277133.845ms
    [2018-01-22 15:51:34.676] [LOG]   Insert into legacy_hash: 384710.568ms
    [2018-01-22 15:51:34.677] [LOG]   Convert: 676551.667ms
    [2018-01-22 15:51:34.695] [LOG]   Create view legacy_object_live: 15.790ms
    [2018-01-22 15:51:34.699] [LOG]   Create type legacy_imported_type: 0.739ms
    [2018-01-22 15:51:34.710] [LOG]   Create table legacy_imported: 10.730ms
    [2018-01-22 15:54:26.471] [LOG]   Insert into legacy_imported: 171763.898ms
    [2018-01-22 15:55:41.596] [LOG]   Delete from legacy_object: 75126.090ms
    [2018-01-22 15:59:09.049] [LOG]   Delete from legacy_hash: 207454.235ms
    [2018-01-22 15:59:09.057] [LOG]   Split imported data: 454371.828ms
    [2018-01-22 15:59:09.573] [LOG]   Add primary key to legacy_list: 18.543ms
    [2018-01-22 15:59:09.615] [LOG]   Add foreign key to legacy_list: 39.912ms
    [2018-01-22 15:59:09.715] [LOG]   Add primary key to legacy_string: 58.895ms
    [2018-01-22 15:59:09.742] [LOG]   Add foreign key to legacy_string: 23.852ms
    [2018-01-22 15:59:38.206] [LOG]   Add primary key to legacy_imported: 28502.418ms
    [2018-01-22 15:59:46.184] [LOG]   Add primary key to legacy_hash: 37123.682ms
    [2018-01-22 16:00:00.551] [LOG]   Add primary key to legacy_set: 51010.067ms
    [2018-01-22 16:00:35.315] [LOG]   Add foreign key to legacy_hash: 49132.757ms
    [2018-01-22 16:00:38.459] [LOG]   Add foreign key to legacy_set: 37909.588ms
    [2018-01-22 16:02:24.917] [LOG]   Add primary key to legacy_zset: 195380.437ms
    [2018-01-22 16:02:32.895] [LOG]   Add foreign key to legacy_zset: 7975.228ms
    [2018-01-22 16:04:26.819] [LOG]   Create index on key__score: 113926.049ms
    [2018-01-22 16:04:26.822] [LOG]   Constraints: 317769.087ms
    [2018-01-22 16:04:26.869] [LOG]   Drop table objects: 46.425ms
    [2018-01-22 16:04:27.322] [LOG]   Drop temporary index on legacy_objects: 35.168ms
    [2018-01-22 16:04:27.323] [LOG]   Cleanup: 500.497ms
    [2018-01-22 16:04:27.326] [LOG]   Alter tables cluster on: 1.401ms
    [2018-01-22 16:04:27.344] [LOG]   [DB] clustering "public.legacy_imported" using sequential scan and sort
    [2018-01-22 16:05:01.695] [LOG]   [DB] "legacy_imported": found 0 removable, 4615586 nonremovable row versions in 292962 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 10.48 s, system: 9.01 s, elapsed: 34.35 s.
    [2018-01-22 16:05:05.241] [LOG]   [DB] clustering "public.legacy_string" using sequential scan and sort
    [2018-01-22 16:05:05.248] [LOG]   [DB] "legacy_string": found 0 removable, 1 nonremovable row versions in 1 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 0.00 s, system: 0.00 s, elapsed: 0.01 s.
    [2018-01-22 16:05:05.285] [LOG]   [DB] clustering "public.legacy_list" using index scan on "legacy_list_pkey"
    [2018-01-22 16:05:05.289] [LOG]   [DB] "legacy_list": found 0 removable, 0 nonremovable row versions in 0 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 0.00 s, system: 0.00 s, elapsed: 0.00 s.
    [2018-01-22 16:05:05.314] [LOG]   [DB] clustering "public.legacy_set" using index scan on "legacy_set_pkey"
    [2018-01-22 16:05:14.314] [LOG]   [DB] "legacy_set": found 0 removable, 4364840 nonremovable row versions in 32116 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 1.76 s, system: 1.35 s, elapsed: 9.01 s.
    [2018-01-22 16:05:17.898] [LOG]   [DB] clustering "public.legacy_zset" using index scan on "legacy_zset_pkey"
    [2018-01-22 16:06:03.028] [LOG]   [DB] "legacy_zset": found 0 removable, 24674902 nonremovable row versions in 209068 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 12.26 s, system: 12.51 s, elapsed: 45.14 s.
    [2018-01-22 16:07:59.241] [LOG]   [DB] clustering "public.legacy_hash" using sequential scan and sort
    [2018-01-22 16:08:49.529] [LOG]   [DB] "legacy_hash": found 8596 removable, 2700249 nonremovable row versions in 571298 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 19.31 s, system: 10.37 s, elapsed: 50.30 s.
    [2018-01-22 16:08:52.527] [LOG]   [DB] clustering "public.legacy_object" using index scan on "legacy_object_pkey"
    [2018-01-22 16:09:01.161] [LOG]   [DB] "legacy_object": found 0 removable, 4238066 nonremovable row versions in 61053 pages
    0 dead row versions cannot be removed yet.
    CPU: user: 2.93 s, system: 1.43 s, elapsed: 8.65 s.
    [2018-01-22 16:09:07.479] [LOG]   Cluster all tables: 280157.823ms
    [2018-01-22 16:09:07.482] [LOG]   [DB] analyzing "public.legacy_object"
    [2018-01-22 16:09:07.694] [LOG]   [DB] "legacy_object": scanned 27084 of 27084 pages, containing 4238066 live rows and 0 dead rows; 30000 rows in sample, 4238066 estimated total rows
    [2018-01-22 16:09:07.720] [LOG]   Analyze legacy_object: 239.270ms
    [2018-01-22 16:09:08.558] [LOG]   [DB] analyzing "public.legacy_hash"
    [2018-01-22 16:09:08.560] [LOG]   [DB] analyzing "public.legacy_list"
    [2018-01-22 16:09:08.562] [LOG]   [DB] analyzing "public.legacy_set"
    [2018-01-22 16:09:08.563] [LOG]   [DB] "legacy_list": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
    [2018-01-22 16:09:08.564] [LOG]   Analyze legacy_list: 10.795ms
    [2018-01-22 16:09:08.567] [LOG]   [DB] analyzing "public.legacy_zset"
    [2018-01-22 16:09:08.645] [LOG]   [DB] analyzing "public.legacy_string"
    [2018-01-22 16:09:08.646] [LOG]   [DB] "legacy_string": scanned 1 of 1 pages, containing 1 live rows and 0 dead rows; 1 rows in sample, 1 estimated total rows
    [2018-01-22 16:09:08.657] [LOG]   Analyze legacy_string: 14.318ms
    [2018-01-22 16:09:08.835] [LOG]   [DB] "legacy_hash": scanned 30000 of 283830 pages, containing 285576 live rows and 0 dead rows; 30000 rows in sample, 2700417 estimated total rows
    [2018-01-22 16:09:09.021] [LOG]   Analyze legacy_hash: 467.155ms
    [2018-01-22 16:09:09.592] [LOG]   [DB] "legacy_set": scanned 30000 of 32115 pages, containing 4077366 live rows and 0 dead rows; 30000 rows in sample, 4364822 estimated total rows
    [2018-01-22 16:09:09.662] [LOG]   Analyze legacy_set: 1108.801ms
    [2018-01-22 16:09:13.965] [LOG]   [DB] "legacy_zset": scanned 30000 of 209023 pages, containing 3540675 live rows and 0 dead rows; 30000 rows in sample, 24674115 estimated total rows
    [2018-01-22 16:09:14.092] [LOG]   Analyze legacy_zset: 5538.742ms
    [2018-01-22 16:09:14.093] [LOG]   Analyze: 6613.416ms
    [2018-01-22 16:09:14.094] [LOG]   100% - 32761320 objects copied (48205 skipped)
    [2018-01-22 16:09:14.094] [LOG]   Copy objects: 3688211.358ms
    

  • Fake News


  • Considered Harmful

    @masonwheeler said in Discussion of NodeBB Updates:

    Go on. Ask me how I know that's what he's going to say...

    Because I posted what he said?



  • @Lorne-Kates said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    if you used a database that supported transactions.

    wat

    AIUI, Ben is trying to figure out how to shift us off of MongoDB (an "eventually correct" NoSQL database) to something else (always correct, which means transactions, and actually normalized, which means SQL).


  • Considered Harmful

    When posting, apparently now I get sent to the page number double the page I should be sent to. Wheee!
    Edit: Guess it's something other than double.
    https://i.imgur.com/Q3Eigb4.png
    112 when I'm on page 45? :thonking:



  • @djls45 Mongo is never correct. It is eventually consistent though.



  • @pie_flavor I got that, too. I think it might have to do with the "go to new post after posting" setting...?


  • Notification Spam Recipient

    @djls45 said in Discussion of NodeBB Updates:

    @pie_flavor I got that, too. I think it might have to do with the "go to new post after posting" setting...?

    Wonder if it's using the default posts-per-page setting instead of whatever the user set? Ben did change it recently...



  • @Tsaukpaetra said in Discussion of NodeBB Updates:

    @djls45 said in Discussion of NodeBB Updates:

    @pie_flavor I got that, too. I think it might have to do with the "go to new post after posting" setting...?

    Wonder if it's using the default posts-per-page setting instead of whatever the user set? Ben did change it recently...

    It did that for me when I had the setting turned on, but it quit once I turned it off.

    Edit: But it doesn't seem to do it any more....


  • I survived the hour long Uno hand

    @pie_flavor
    Expected root cause: Your profile is set to use 50 posts per page, and the server default is 20 posts per page. And the redirection logic is using server default instead of your profile to calculate what page to send you to.



  • @izzion Ah, except that Ben changed the default to 50, so if I set my posts/page to 20, I should still get the wrong page?



  • @djls45 Or maybe I need to refresh after saving first...



  • @djls45 Yup. I set it to 20, and posting sent me to page 45 (starting with post 881).


  • I survived the hour long Uno hand

    @djls45
    🤷♂ You expect my math to actually be correct when I'm doing wild speculation and Psychic Troubleshooting(tm)?



  • @izzion Well, it seems to work out, at least this time.


  • I survived the hour long Uno hand

    @djls45
    Aside from my numbers being inverted, but hey.


  • Considered Harmful

    @ben_lubar You should really post something sometime.
    https://i.imgur.com/HODvfHa.png


  • Notification Spam Recipient

    @pie_flavor said in Discussion of NodeBB Updates:

    @ben_lubar You should really post something sometime.
    https://i.imgur.com/HODvfHa.png

    ITYM: NodeBB should really figure out post permission server-side sometime.



  • → [2018/1/22] Fix topics in categories per user if they were moved... OK
    → [2017/12/18] Give chat privilege to registered-users... OK
    → [2018/1/8] Fix sort by votes for moved topics... OK
    → [2018/1/3] Give upload privilege to registered-users globally if it is given on a category... OK
    → [2018/1/12] Rename privileges:downvote and privileges:flag to min:rep:downvote, min:rep:flag respectively... OK
    → [2018/1/9] Give vote privilege to registered-users on all categories... OK


  • Notification Spam Recipient

    @ben_lubar said in Discussion of NodeBB Updates:

    OK

    Why are you listing things out of chronological order?



  • @tsaukpaetra said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    OK

    Why are you listing things out of chronological order?

    That's the order that the database updates were in when I ran the upgrade locally.


  • Notification Spam Recipient

    @ben_lubar said in Discussion of NodeBB Updates:

    @tsaukpaetra said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    OK

    Why are you listing things out of chronological order?

    That's the order that the database updates were in when I ran the upgrade locally.

    Huh....


  • Grade A Premium Asshole

    @tsaukpaetra said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    @tsaukpaetra said in Discussion of NodeBB Updates:

    @ben_lubar said in Discussion of NodeBB Updates:

    OK

    Why are you listing things out of chronological order?

    That's the order that the database updates were in when I ran the upgrade locally.

    Huh....

    An autist has confused a Mormon cyborg.

    I may never get to use that phrase honestly ever again. I was not going to let it pass by. Carry on.



  • The search autocomplete box on Android doesn't go away when I click something else. It's annoying.


  • I survived the hour long Uno hand

    @ben_lubar said in NodeBB Updates:

    @ben_lubar said in NodeBB Updates:

    Redis is no longer required for multi-core NodeBB instances, but we'll stay with Redis for a bit.

    Update: No more Redis!

    Sessions were copied over, so there shouldn't be any interruption (apart from the Docker container restart). Let me know if anything cross-instance isn't working properly. (For example, chats, notifications, weird post caching issues...)

    Glad to know that, in true WTDWTF fashion, “a bit” is less than 6 hours. 🍹 🍿



  • @polygeekery wait, is @Tsaukpaetra Mormon?


  • Grade A Premium Asshole

    @anotherusername we are all Mormons here.

    :spartacus.meme:


  • Considered Harmful

    How to know if you've signed into a new device: the sidebar on your original device is BACK ON THE FUCKING LEFT


  • Grade A Premium Asshole

    @pie_flavor go back to your Discourse forum. The complaining is annoying.


  • Considered Harmful

    @polygeekery Would you say you're certainly very, very tired of hearing about this?


  • 🚽 Regular

    @ben_lubar said in NodeBB Updates:

    We will be upgrading to NodeBB 1.7.4 today at 18:00 UTC. [rainbows]

    (Yes, that is quite a while from now, but it's 1 AM right now where I am.)

    Also included in this update:

    • :sideways_owl: transparency
    • :kneeling_warthog: added
    • My MongoDB patch that makes determining a post's index in a thread not load every post in that thread. https://github.com/NodeBB/NodeBB/pull/6229
    • Redis is no longer required for multi-core NodeBB instances, but we'll stay with Redis for a bit.

    Can't say I'm happy with this update.

    0_1516991784381_Capture.PNG
    0_1516991790934_Capture2.PNG
    0_1516991798545_Capture3.PNG
    0_1516991806842_Capture4.PNG

    Also the header is gone, once inside a thread.


Log in to reply