|
|
large csv files
The thing I like to most in my calculator is the possibility to do
some calculations without using my PC.
For my job I have to create some system performance reports that I
create working with csv files created by the processing system.
I am able to load these csv files on my 49G+ as strings and my program
parse the file, do some calculations and create a report table I send
to my desktop pc to create a report.
I like to use the HP for this because I can do dates calculation with
ease, feed list and matrix quickly. Please also consider that the RPL
language is the one I know the best.
My problem arise when I had to load a file of 800KB... Not enough
space in the calculator. Even if I had a card reader to put in on the
SD card, I couldn't put the 800KB string on the stack to be parsed...
Is there any chance I can extract smaller portions of the file without
having to recall the file in the stack?
I would like to avoid to manually chunk the original file, modify my
program that check for the total number of records and so on...
Any idea?
Thank you very much.
Giancarlo Cot_ruf@yahoo.it
(Remove the underscore)
|
|
0
|
|
|
|
Reply
|
cotruf
|
4/16/2004 9:18:58 AM |
|
I couldn't put the 800KB string on the stack to be parsed...
>
> Is there any chance I can extract smaller portions of the file without
> having to recall the file in the stack?
>
> I would like to avoid to manually chunk the original file, modify my
> program that check for the total number of records and so on...
>
> Any idea?
>
> Thank you very much.
>
> Giancarlo Cot_ruf@yahoo.it
> (Remove the underscore)
If you figure this one out... please let me know.
John Evers
|
|
0
|
|
|
|
Reply
|
john
|
4/16/2004 1:48:23 PM
|
|
I guess this could be done in ARM assembly by someone who knows how the
internal parts of the 49 are, basically by noone on this group except maybe
Jean-Yves or Cyrille but I doubt they would do it.
Arnaud
|
|
0
|
|
|
|
Reply
|
Arnaud
|
4/16/2004 2:50:15 PM
|
|
"Arnaud Amiel" <aamiel@hotmail.com> wrote in message news:<OtSfc.363$DX3.216@newsfe1-win>...
> I guess this could be done in ARM assembly by someone who knows how the
> internal parts of the 49 are, basically by noone on this group except maybe
> Jean-Yves or Cyrille but I doubt they would do it.
>
> Arnaud
I've often thought that the card reader would be of great use if it
there were user rpl commands that could be used to perform file I/O
(e.g. C run time file handles). The amount of ram that is available
is plenty to parse a lot of file data and process the desired
portions.
Regards,
Jon Trauntvein
|
|
0
|
|
|
|
Reply
|
j
|
4/17/2004 4:45:41 AM
|
|
Hello Arnaud,
maybe it's too early for your approach. Anyway I think that it
could be useful to a lot of people.
I was dreaming also about having a RPL pc compiler that create code
that can run on my pc but this is another story. I would pay for it...
Have a nice day,
Giancarlo Cot_ruf@yahoo.it
(remove underscore)
"Arnaud Amiel" <aamiel@hotmail.com> wrote in message news:<OtSfc.363$DX3.216@newsfe1-win>...
> I guess this could be done in ARM assembly by someone who knows how the
> internal parts of the 49 are, basically by noone on this group except maybe
> Jean-Yves or Cyrille but I doubt they would do it.
>
> Arnaud
|
|
0
|
|
|
|
Reply
|
cotruf
|
4/17/2004 9:11:34 AM
|
|
|
4 Replies
186 Views
(page loaded in 0.12 seconds)
Similiar Articles: Reading a large mixed CSV file of unknown types and size - comp ...hello. I have a CSV file. I don't know in advance what size it is (rows, cols) nor do I know the types associated with each col. The CSV contains mix... Reading a big .CSV file into SAS - comp.soft-sys.sasReading a large mixed CSV file of unknown types and size - comp ... Reading a big .CSV file into SAS - comp.soft-sys.sas Reading a large mixed CSV file of unknown types ... Using textscan to read a csv file - comp.soft-sys.matlab ...Hi, I'm using textscan to read a very large csv file consisting of four columns, the first two contain strings, the third a double and the fou... help reading csv file with string - comp.soft-sys.matlab ...Use strings with urlwrite - comp.soft-sys.matlab help reading csv file with string - comp.soft-sys.matlab ... Reading a large mixed CSV file of unknown types and size ... df output after deleting large file - comp.unix.solarisdelete columns csv file - comp.lang.awk Using textscan to read a csv file - comp.soft-sys.matlab ... df output after deleting large file - comp.unix.solaris delete columns ... file differece for two xsvf files - comp.arch.fpgaUsing textscan to read a csv file - comp.soft-sys.matlab ..... to read a very large csv file consisting of four columns, the first two ... don't see any differences in ... Load csv file into MATLAB workspace on a Mac - comp.soft-sys ...Load csv file into MATLAB workspace on a Mac - comp.soft-sys ..... one structure per column in the csv) were muddled > with data ... read a very large csv file ... Large file problems - block pattern - comp.lang.awkm file problem - comp.soft-sys.matlab Large file problems - block pattern - comp.lang.awk Hi, I'm using textscan to read a very large csv file ... does work but I start to ... delete columns csv file - comp.lang.awkdf output after deleting large file - comp.unix.solaris delete columns csv file - comp.lang.awk ... Hi, Some CSV (comma-separated values) files have the following layout ... How to plot data from a csv file in matlab? - comp.soft-sys.matlab ...Reading a large mixed CSV file of unknown types and size - comp ... How to plot data from a csv file in matlab? - comp.soft-sys.matlab ... Reading a large mixed CSV file ... Splitting large csv files – the CSV Splitter | The Coding PadCarrying on with the theme of data files and databases, I am going to talk a bit about .csv files. csv stands for Comma Separated Variables, and is a CSV splitter (divide large CSV files) - Forex Trading | MetaTrader ...Hello everyone, Well scorpion provided me with a 2Gb file of tick data of EUR/USD sinc 1998 I believe. I know that MetaTrader and my computer itself 7/27/2012 2:49:30 PM
|
|
|
|
|
|
|
|
|