Register   Login
     
  Latest Posts  
RE: Featured articles: what's mean exactly?
by gicannalire on 11/19/2008 1:45 PM
RE: direct link to a special album
by smcculloch on 11/19/2008 1:15 PM
RE: Is the Archive module an archive or an index?
by smcculloch on 11/19/2008 1:15 PM
RE: Does the contact form not get a logged in users details?
by smcculloch on 11/19/2008 1:14 PM
RE: token that lets me link to a download file
by smcculloch on 11/19/2008 1:13 PM
RE: Combining Simple Gallery With Articles...
by smcculloch on 11/19/2008 1:13 PM
RE: AutoFill fields by selection Type
by smcculloch on 11/19/2008 1:12 PM
RE: Ratings button appears to anonymous users
by smcculloch on 11/19/2008 1:11 PM
RE: Redirecting non-DNN generated urls
by smcculloch on 11/19/2008 1:10 PM
RE: Archive Issue
by smcculloch on 11/19/2008 1:09 PM
  Forums  
Subject: Accessing/Importing External Data
Prev Next
You are not authorized to post a reply.

Author Messages
Jack HoelzUser is Offline
Gold Membership
Nuke Master
Nuke Master
Posts:808


6/03/2005 8:18 PM  
I have a comma separated txt file that contains about 150,000 records that I would like to access through a dnn site. This needs to be searchable and sortable by column if possible. I would also like to make it easy to update with a new .txt file if possible. I'm a complete db dummy, but if any could point me in the right direction I would be very grateful!
 
I have done it in the past with access and the db wizard in front page, but I'm sure there is a much better way.

Get The Net!!

Jack Hoelz
Peter WarrenUser is Offline
Gold Membership
Nuke Addict
Nuke Addict
Posts:77

6/06/2005 5:05 PM  
Can you give us some more information like:
Do each of the uploaded files contain the same columns?
Does any data need to be converted (datetime, different format, lookup values, case, etc)?
Are you hosting the site yourself or is it at an ISP?
Can you create additional SQL tables for your exclusive use?
Should you have an associated batch number with the upload so that you can store multiple copies in the table for later comparison?
If at ISP, will they allow uploading of custom modules?
What type of reports do you need?
How many reports do you need?
Could you compile multiple reports (column sort,filtered) on your local PC and upload the reports to the server for viewing instead of the actual data?
 
Jack HoelzUser is Offline
Gold Membership
Nuke Master
Nuke Master
Posts:808


6/06/2005 5:16 PM  
It's a genology database. You can see what I need here
 
I have complete control of the server and the associated database so I can create a custom table in it.
 
Multiple copies are not required.
 
The reports required are what you see.
 
Hope that helps

Get The Net!!

Jack Hoelz
Peter WarrenUser is Offline
Gold Membership
Nuke Addict
Nuke Addict
Posts:77

6/06/2005 5:46 PM  
A suggestion.
If you are using MS SQL Server:
Import data using Enterprise Manager to create the table from the file, then modify the column types and length to suit the data being imported. 
You can delete all records and import again using this table to save you modifying it again or create a script of the table and use it to drop table and create a new table.
You can create a local SQL package to automate this -
Open Enterprise Manager, select Data Transformation Services and create local package.
Using this package, you basically tell SQL the file name and it will import it into a table. 
You can set up a job in SQL to import the data.  Part of the package could be a step that checks for a new file.
 
Scott McCullochUser is Offline
Administrators
Nuke Master
Nuke Master
Posts:12427


6/07/2005 1:14 AM  
I don't know about anything automatic for column sorting, searching, but it is fairly easy to write in a grid if you can import the data using a DTS like Peter has said..

Scott McCulloch
Site Administrator
Peter WarrenUser is Offline
Gold Membership
Nuke Addict
Nuke Addict
Posts:77

6/07/2005 5:07 AM  
jhoelz can use the existing routines that he has and just change the datasource.
You are not authorized to post a reply.
Forums > General > DotNetNuke Questions > Accessing/Importing External Data



ActiveForums 3.7