The Official Status Thread
-
@Zecc said in The Official Status Thread:
Apparently "it's easier to get an .xlsx than a .csv" from the external data source we will need to integrate with.
Also it's happened enough times that I've had to export a .csv from a .xlsx before writing aone-off
data mangling script†, so it's a good thing to add to my C# toolbelt I guess...
And after I thought about it for a bit... xlsx is the more "exact" format, where you can give format specifiers to cells and not have to play ridiculous games like specifying cell formulas in the CSV (examples all over this forum) to get Excel to display it properly.
So now that I've thought about that, I'd probably have the same response @error's coworker did (do it yourself if you want to convert to an inferior/less-specified file format).
-
@heterodox said in The Official Status Thread:
@Zecc said in The Official Status Thread:
Apparently "it's easier to get an .xlsx than a .csv" from the external data source we will need to integrate with.
Also it's happened enough times that I've had to export a .csv from a .xlsx before writing aone-off
data mangling script†, so it's a good thing to add to my C# toolbelt I guess...
And after I thought about it for a bit... xlsx is the more "exact" format, where you can give format specifiers to cells and not have to play ridiculous games like specifying cell formulas in the CSV (examples all over this forum) to get Excel to display it properly.
So now that I've thought about that, I'd probably have the same response @error's coworker did (do it yourself if you want to convert to an inferior/less-specified file format).
His fucking ticket says "deliver a CSV file to @error to be converted into DumbFuckML3.5 so it can be imported." Who gives a shit about cell formatting? The destination is a database that doesn't have a concept of formatting. Do what the requirements say.
TBH I don't know why it's a two step process at all. Probably so they could divide the task between two devs.
If you don't like the requirements, get them changed. Don't go rogue and choose a format you like better.
-
-
@error said in The Official Status Thread:
The destination is a database that doesn't have a concept of formatting.
Ah, yes, a stringly typed database...
-
@Zenith said in The Official Status Thread:
@error said in The Official Status Thread:
The destination is a database that doesn't have a concept of formatting.
Ah, yes, a stringly typed database...
If only you knew...
-
@error said in The Official Status Thread:
His fucking ticket says "deliver a CSV file to @error to be converted into DumbFuckML3.5 so it can be imported." Who gives a shit about cell formatting? The destination is a database that doesn't have a concept of formatting. Do what the requirements say.
The requirements are wrong.
No, really I get what you're saying, but any conversion tool that uses CSV in 2020 is a bad tool. It's using a format that's incompletely specified and doesn't have enough metadata. It doesn't even have a canonical representation of NULL, which would be a useful thing for a conversion tool to have, I dare say.
-
@heterodox said in The Official Status Thread:
@error said in The Official Status Thread:
His fucking ticket says "deliver a CSV file to @error to be converted into DumbFuckML3.5 so it can be imported." Who gives a shit about cell formatting? The destination is a database that doesn't have a concept of formatting. Do what the requirements say.
The requirements are wrong.
No, really I get what you're saying, but any conversion tool that uses CSV in 2020 is a bad tool. It's using a format that's incompletely specified and doesn't have enough metadata. It doesn't even have a canonical representation of NULL, which would be a useful thing for a conversion tool to have, I dare say.
If the requirements are wrong, the solution architect should rewrite them. Until then, the developer should do what the SA wrote. We can't coordinate a team of this size if each dev just does their own thing.
And for this particular task, a one-off data import, the cost of implementing xlsx parsing far, far exceeds the questionable benefit of metadata describing what is a fixed and well-known schema.
-
@error said in The Official Status Thread:
And for this particular task, a one-off data import, the cost of implementing xlsx parsing far, far exceeds the questionable benefit of metadata describing what is a fixed and well-known schema.
I agree hence the
. :) Not like I've had to deal with the same throughout my career.
-
@heterodox said in The Official Status Thread:
And after I thought about it for a bit... xlsx is the more "exact" format, where you can give format specifiers to cells and not have to play ridiculous games like specifying cell formulas in the CSV (examples all over this forum) to get Excel to display it properly.
So now that I've thought about that, I'd probably have the same response @error's coworker did (do it yourself if you want to convert to an inferior/less-specified file format).
That's great, but for pure data with a well-known schema XML or JSON would have done just fine.
Also, an xlsx needs to be fully downloaded before I can start processing the data.
-
@Zecc said in The Official Status Thread:
That's great, but for pure data with a well-known schema XML or JSON would have done just fine.
Sure. Anything but CSV.
Also, an xlsx needs to be fully downloaded before I can start processing the data.
Hmmm, does it? I know it's a zip but aren't there streaming zip algorithms since the TOC is up front? Now I want to test this.
-
@heterodox said in The Official Status Thread:
Also, an xlsx needs to be fully downloaded before I can start processing the data.
Hmmm, does it? I know it's a zip but aren't there streaming zip algorithms since the TOC is up front? Now I want to test this.
If your transport supports random access, and the access library supports random access to, I see no issue.
-
@heterodox said in The Official Status Thread:
Hmmm, does it? I know it's a zip but aren't there streaming zip algorithms since the TOC is up front? Now I want to test this.
Okay, I was thinking of tar, where the TOC is at the end.
Either way, just the fact that xlsx cells might have their content in a string table rather than inline† throws a spanner in the works.⋈
†As was the case with the sample I was provided.
⋈TRWTF is that Open XML SDK doesn't abstract this away. In a way it's actually nice that they allow us to micromanage this sort of things if we want when producing the file, but for simply reading? Just give me a method on the sheet, cell, or both that returns the effective value, FFS.
-
@Tsaukpaetra said in The Official Status Thread:
If your transport supports random access, and the access library supports random access to, I see no issue.
You underestimate the power of the
.
-
FFS I'm 10% allocated to this project. I have at most 4 hours to do this task and I'd spend half that just researching the damn file format.
-
Status: Just have to say, it's great for Dice's password reset links to be expired before they send them.
Another great one is that if you've turned off ZipRecruiter's newsletter spam, they don't send password reset links either.
-
Status: Just replaced a couple LEDs on my keyboard. They're a slightly different format than the original ones (3mm round ones vs some kind of rectangular ones), and a bit brighter, but at least I can find my Num Lk and Prt Sq keys in the dark. This has already improved my life tremendously.
-
Status: I haven't been to /r/thathappened in a while. So I open it up and see this at the top:
I haven't even looked at what's below but I already know that 99 out of every 100 posts is about COVID. Suddenly I lost interest in browsing Reddit.
-
@Gąska said in The Official Status Thread:
I haven't even looked at what's below but I already know that 99 out of every 100 posts is about COVID.
Not in that subreddit.
-
@loopback0 hm. A normie sub that's unlike all other normie subs. Interesting.
-
Status: Fan costs $10 more if I want it in black...
-
Status: Overdosed on niece & nephews this afternoon. Have to sit in a chair for 3 hours of raid this evening.
Here's hoping the Advil kicks in quick.
-
Status: I've felt crappy for most of a week now.
Started with a really stiff neck/shoulder on one side and general fatigue. Chalked it up to a bad pillow/horrible posture.
Turned into a persistent headache/neck-ache, along with a sensation as if the tip of my tongue was numb.
Last night added jaw pain and now today a complete lack of energy. I've slept plenty, but I can barely stay awake and have no desire to do anything. One eye is worse than the other. I can see fine, just can't keep it open very well. Walking up and down the stairs (I'm on the 3rd floor) left me feeling close to collapse.
No cough or breathing obstruction, plus I haven't exactly been around people.
Current thought is a systemic infection due to a tooth gone bad--likely an abscess formed under a root-canalled/crowned tooth that was done almost 15 years ago. Oddly I don't have any of the other major symptoms of that--no sensitivity, not much swelling that I can tell, no real fever.
Ugh.
-
@Tsaukpaetra said in The Official Status Thread:
Status: Fan costs $10 more if I want it in black...
LOL the rhythm of that sentence and the number of syllables match the song perfectly!
-
I've been playing Dark Souls Remastered to prep for Demon's Souls on PS5.
Holy shit, it's good, too.
-
@Gąska said in The Official Status Thread:
@loopback0 hm. A normie sub that's unlike all other normie subs. Interesting.
Yeah, that happened.
-
@Gąska said in The Official Status Thread:
@Tsaukpaetra said in The Official Status Thread:
Status: Fan costs $10 more if I want it in black...
LOL the rhythm of that sentence and the number of syllables match the song perfectly!
Paint It, Black
-
@heterodox said in The Official Status Thread:
I know it's a zip but aren't there streaming zip algorithms since the TOC is up front?
The zip TOC is at the end, and the format's basically unsuitable for streaming. (It's good for many other things, such as appending to an executable, but not streaming.) If you want streaming compression, the most common format used now is gzip.
-
@error said in The Official Status Thread:
FFS I'm 10% allocated to this project.
That's what we call the “I'm just here for the meetings” level of effort.
-
@Zecc said in The Official Status Thread:
Paint It, Black
The interesting thing is that I found multiple YT videos that have that comma.
-
Status: Poking around I find this:
where the body text, apart from listing some function names, is just:
document me!
I feel better about the state of my own documentation now.
-
@dkf said in The Official Status Thread:
I feel better about the state of my own documentation now.
I've seen documentation generators that just contort the method names. It's worse than useless.
/// <summary>frobs the blargh</summary> public void FrobBlargh() {}
-
@error said in The Official Status Thread:
FFS I'm 10% allocated to this project. I have at most 4 hours to do this task and I'd spend half that just researching the damn file format.
Either you're way faster than I imagine or .xlsx is way less complicated than I imagine. Given the quarrel about the ISO standardization of OOXML as thousands of pages under-specified garbage, I can't fathom figuring out a parser for that shit in two hours.
-
@topspin said in The Official Status Thread:
Either you're way faster than I imagine or .xlsx is way less complicated than I imagine. Given the quarrel about the ISO standardization of OOXML as thousands of pages under-specified garbage, I can't fathom figuring out a parser for that shit in two hours.
There was an implicit assumption that I'd locate a suitable API, not start from scratch. That is several leagues away from being in scope.
-
At this rate, I should reach my target body weight just in time to fuck it up on Thanksgiving.
-
@topspin said in The Official Status Thread:
Either you're way faster than I imagine or .xlsx is way less complicated than I imagine.
If you're just doing data extraction on cells that don't contain formulæ and don't care about the formatting other stuff like that, it shouldn't be too complex; the basic structure isn't totally insane despite XML not being the greatest way of representing a spreadsheet that ever existed. The tricky bits all come about with computed cells and formatting; the latter has (from what I've heard and seen) lots of hacks to emulate old ways of doing things that are just carried around from old documents. The DOCX format (which I've looked at more for a few unimportant reasons) has all sorts of crap like that, and yet the only time you actually see the crappy underdocumented bits is when something's been carried around for many years from ancient versions of stuff. It's what you need when you want precise reproducibility across several decades and major software versions, but most users are actually mainly about getting things Good Enough™, at least when push comes to shove.
-
I've been mentally pronouncing @Gąska's name as Gaska, but I actually have an inkling of how it's meant to be pronounced.
So henceforward I will make it my missą to mentally pronące it with the correct sąd.
-
@Zecc said in The Official Status Thread:
I've been mentally pronouncing @Gąska's name as Gaska
I still do even after finding out the correct pronunciation.
-
@dkf said in The Official Status Thread:
The DOCX format (which I've looked at more for a few unimportant reasons) has all sorts of crap like that, and yet the only time you actually see the crappy underdocumented bits is when something's been carried around for many years from ancient versions of stuff
I've got a design template like that. It's an ODT template which was rewritten from scratch a few years ago, but I'm pretty sure that 'scratch' was 'the old DOC template, with all the text removed but the styles kept'.
Liberoffice doesn't like it but does its best. The online document review tool generally messes it up. One of these years I ought to transfer the text without layout to a new document without any styling baggage.
-
-
@Gąska said in The Official Status Thread:
@Zecc said in The Official Status Thread:
Paint It, Black
The interesting thing is that I found multiple YT videos that have that comma.
Wikipedia to the rescue:
"Paint It Black" (originally released as "Paint It, Black")
I skimmed the article and there doesn't seem to be any more explanation
-
So are they preparing my order or is it out for delivery? :who_nose:
-
Brain status: The sąd of silęce.
-
@loopback0 said in The Official Status Thread:
@Zecc said in The Official Status Thread:
I've been mentally pronouncing @Gąska's name as Gaska
I still do even after finding out the correct pronunciation.
It's currently in black-tier storage (i.e. Unlikely to ever be used), so the default crunged vocalization is always used internally.
-
@loopback0 said in The Official Status Thread:
@Zecc said in The Official Status Thread:
I've been mentally pronouncing @Gąska's name as Gaska
I still do even after finding out the correct pronunciation.
Same. It was just too hard, so I forgot about it again.
-
@loopback0 said in The Official Status Thread:
@Zecc said in The Official Status Thread:
I've been mentally pronouncing @Gąska's name as Gaska
I still do even after finding out the correct pronunciation.
It's not
(Also, I learned his name means goose. Why did his parents name him goose?
)
-
@error said in The Official Status Thread:
(Also, I learned his name means goose. Why did his parents name him goose?
)
Why did your parents name you error?
-
@Gąska said in The Official Status Thread:
@error said in The Official Status Thread:
(Also, I learned his name means goose. Why did his parents name him goose?
)
Why did your parents name you error?
Typo on my birth certificate.
-
@Gąska said in The Official Status Thread:
@error said in The Official Status Thread:
(Also, I learned his name means goose. Why did his parents name him goose?
)
Why did your parents name you error?
Because he lives alone in his Ruto town house?
-
@error said in The Official Status Thread:
Why did his parents name him goose?
They really liked Top Gun but didn't like him enough to call him Maverick.
-
@topspin said in The Official Status Thread:
@Gąska said in The Official Status Thread:
@error said in The Official Status Thread:
(Also, I learned his name means goose. Why did his parents name him goose?
)
Why did your parents name you error?
Because he lives alone in his Ruto town house?
Deep cut. Nice.
Say hi to Bagu for me.