SAS ETL studio - How to call ETL jobs from base/macro SAS

Hi,

I am trying to develop a datamart on SAS ETL studio which I had
otherwise developed using BASE SAS & Macro SAS. However, I am facing
some problem in developing the datamart through ETL studio. I have one
main macro that reads in the process (basically  macro) names that are
to be executed and then executes them one after another. The process
information is logged in control tables (also on SAS). The information
logged is related to start/end date-time of the process, the return
code etc.

I am not quite sure how I can use ETL studio for achieving the same
objective. I can create the processes (macros) as jobs on ETL studio.
However the main macro will be on Base/Macro SAS. Now, how can I call
the ETL jobs from this main program which is on  Base/Macro SAS? I
assume we cannot have a main program created on ETL studio. The reason
I am asking this question is because I could not see where the ETL jobs
get stored physically (as a .sas file)

Can anybody help me in solving this problem.Is a extensive use of User
Tranformation templates a common practice?

Also, I had a discussion with my friends who are working on
Informatica. According to them Informatica provides some inbuilt
metadata tables that stores information related to which table was
updated by which job and at what date/time  and user etc..is there
anything like that available on SAS ETL studio also?

Thanks,
Ankit

0
1/19/2006 6:47:06 AM
comp.soft-sys.sas 136703 articles. 1 followers. Post Follow

1 Replies
203 Views

Similar Articles

[PageSpeed] 46
Ankit,

It's unclear to me what you want to do with the existing macros and the calling them from ETL Studio. But a few things come to mind.

1. ETL Studio jobs which are to be run in production must be deployed. Deployment directories are defined in Management Console and associated with a SAS Batch Server. When a job is deployed, ETL Studio generates a static SAS program in the deployment directory. Until the job is deployed the job only exists in metadata.

2. Macros can be called by User Written Code transformations that you place in the job, in the pre- and post-process steps for the job, and by writing your own code for a SAS-supplied transformation (e.g. Extract, Join, Sort). My suggestion would be to control the fmtsearch option so that the macros can be autocalled or you can %include the macro files. This allows you to modify the macro without having to redeploy the job.

3. Look at the status handling for a transformation or the job to maintain the history you are talking about. You can use one of the pre-built actions or use Custom, which can call a macro. Remember that you can have several checks in status handling and thus handle multiple situations. Since some of these capabilities are pretty basic, see #4.

4. You can write your own SAS code transformation to record the update information you want and place it immediately after a data set in the job. I've used SAS Code Transformations quite often to good effect, both to handle job-specific issues (e.g. multiple inputs and multiple outputs in a single transformation) and for shared capabilities (e.g. emails, conditional execution, duplicate processing in multiple jobs).

I hope this helps...

Clint

-----Original Message-----
From: SAS(r) Discussion [mailto:SAS-L@LISTSERV.UGA.EDU]On Behalf Of
Ankit
Sent: Thursday, January 19, 2006 1:47 AM
To: SAS-L@LISTSERV.UGA.EDU
Subject: SAS ETL studio - How to call ETL jobs from base/macro SAS


Hi,

I am trying to develop a datamart on SAS ETL studio which I had
otherwise developed using BASE SAS & Macro SAS. However, I am facing
some problem in developing the datamart through ETL studio. I have one
main macro that reads in the process (basically  macro) names that are
to be executed and then executes them one after another. The process
information is logged in control tables (also on SAS). The information
logged is related to start/end date-time of the process, the return
code etc.

I am not quite sure how I can use ETL studio for achieving the same
objective. I can create the processes (macros) as jobs on ETL studio.
However the main macro will be on Base/Macro SAS. Now, how can I call
the ETL jobs from this main program which is on  Base/Macro SAS? I
assume we cannot have a main program created on ETL studio. The reason
I am asking this question is because I could not see where the ETL jobs
get stored physically (as a .sas file)

Can anybody help me in solving this problem.Is a extensive use of User
Tranformation templates a common practice?

Also, I had a discussion with my friends who are working on
Informatica. According to them Informatica provides some inbuilt
metadata tables that stores information related to which table was
updated by which job and at what date/time  and user etc..is there
anything like that available on SAS ETL studio also?

Thanks,
Ankit
0
Rickards
1/19/2006 3:11:45 PM
Reply:
Similar artilces about - SAS ETL studio - How to call ETL jobs from base/macro SAS:

How to add a system call?
What should I do if I want to add a system call for MINIX? Please help! Thanks. Hi Jason, suknang@21cn.com (Jayson) wrote in message news:<a22b6be8.0311260448.5950bd31@posting.google.com>... > What should I do if I want to add a system call for MINIX? Its a little long to explain, you can take assigment 40 from: http://brlivre.sytes.net/minix/patchs/patchs.en.html as example. If you have questions, mail me. :) -- Luiz Capitulino lcapitulino@terra.com.br (Luiz Capitulino) wrote in message news:<d636bbf9.0311261345.4efa5e81@posting.google.com>... > Hi Jason, > >...

SAS/C Y2K error?
I'm making use of __DATE__ with SAS/C for the first time and discovered that the date is off by one day. At first I thought my RTC might be out of line with reality but it is correct. SASI made a Y2K error when they implemented the __DATE__ operations? In article <20050630.7A24BB0.8B8D@mojaveg.iwvisp.com>, Everett M. Greene wrote: > I'm making use of __DATE__ with SAS/C for the first > time and discovered that the date is off by one day. > At first I thought my RTC might be out of line with > reality but it is correct. SASI made a Y2K error > when...

2/10-2/14 Unofficial SAS Weblog Posts
2/10-2/14 Unofficial SAS Weblog Posts http://sas.weblogsinc.com/ CODE: Ready, Set, GO! GO! GO! GO! ... GO! Feb 14, 2005, 12:03 AM ET http://sas.weblogsinc.com/entry/1234000523031498/ SEMI-OT: BS in CS = Java Vocational Training? Feb 13, 2005, 12:38 AM ET http://sas.weblogsinc.com/entry/1234000133031437/ NEWS: Back to e-School Feb 12, 2005, 11:22 PM ET http://sas.weblogsinc.com/entry/1234000530031430/ TIPS: Rolling Your Own SAS Help Feb 10, 2005, 11:31 PM ET http://sas.weblogsinc.com/entry/1234000537031240/ ...

Re: Do you think sas programmers should only use sas? #28
Agree totally...maybe the difference between a statistician and a programmer! Susie Li TV Guide 1211 Avenue of the Americas New York, NY 10036 Tel 212.852.7453 Email susie.li@tvguide.com -----Original Message----- From: SAS(r) Discussion [mailto:SAS-L@LISTSERV.UGA.EDU] On Behalf Of Richard Read Allen Sent: Tuesday, August 09, 2005 3:14 PM To: SAS-L@LISTSERV.UGA.EDU Subject: Re: Do you think sas programmers should only use sas? Toby, You need a spell-checker badly. :-) Richard (one of those statistician-programmers) At 12:45 PM 8/9/2005, Toby wrote: >SIg, > >I think I am the caus...

US-PA: King of Prussia-SAS Programmers #7
************************************************************** JobCircle.com - Careers, Content and Community for Technology professionals in the Northeastern United States! Jobcircle.com provides resume submission, classified searches, eLearning, hundreds of career development articles, tech news, and more to tens of thousands of Technology professionals in your area - visit us today at http://www.jobcircle.com! !!! Voted a TOP 50 Career Web Site in 2002 by CareerXRoads !!! ************************************************************** Job Title: SAS Programmers Job Loca...

voip to voip calls
I really new to this, so I hope the question isn't too basic. I have established an account with a voip provider - Teliax. I set up the soft phone (xten) and got the ATA today (Lynksys PAP-2) and set that up. I don't have a phone number yet because I want to test the system and everything is OK. I will have my current phone number ported over. In the mean time, is there a way for other voip users to call me? For instance, can they use an address like username.voip.teliax.com to ring me using a softphone? Usually, peer-to-peer is free. If you know another user on the...

10th JELIA: Call for Participation
CALL FOR PARTICIPATION TO THE 10th JELIA European Conference on Logics in AI Liverpool, 13 - 15 September, 2006 The registration for JELIA'06 is now open: http://www.csc.liv.ac.uk/~jelia06 JELIA this year accepted 34 papers, 12 system demonstrations, and attracted 3 well-known invited speakers: * Saso Dzeroski (Ljubljana) * Illka Niemela (Helsinki) * Andrei Voronkov (Manchester) On top of this, we have a grant scheme for students in place! Registration is open until 14th of August, and the fee includes a copy of the proceedings, conference dinner, social...

INNS-BigData 2015: Call for Special Sessions
[Apologies for cross-postings] ########################################### The inaugural INNS Big Data conference 2015 August 8-10, 2015, San Francisco, USA CALL FOR SPECIAL SESSIONS ########################################### Homepage: http://www.innsbigdata.org ########################################### About the Conference ########################################### Big data is not just about storage of and access to data. Analytics play a = big role in making sense of that data and exploiting its value. But learnin= g from big data has become a significant chal...

SAS 9.1 is Here
At least for Solaris, we received it last week. Be forewarned: The installation instructions are... I just can't think of an adequate description. Thorough, yes, but voluminous! Gone are the days when one could blindly feed CDs to perform an install. Tim Braam US Census Bureau On 2 Feb 2004 07:19:21 -0800, timothy.j.braam@census.gov (Tim Braam) wrote: >At least for Solaris, we received it last week. SI has just told me that general availability (i.e., for sites not on the LA list) of 9.1 for the Win32 platform will be "2nd quarter". JW "Tim Braam" <timoth...

System Exec and Call Library Function problems
I have working c code. The code connects to a server; makes a request; and gets a return.&nbsp; It works from the command line. In LV there are problems.&nbsp; If I try running it using the System Exec vi, I get the response I expect but not until the connection with the server is broken. This is unacceptible and not the way it works from the command line. If I try to use the Call Library Function Node, the response is even stranger.&nbsp; I just call the routine that is supposed to connect to the server. It fails. I attached the vi's. As you will see, they are very simple. ...

Re: SAS & .Net ?? #3
hi, I suggest you to go to read the exchanges of e-mails to this subject (java and .net), in the archives of SAS-L. The period has to be between October, 2004 and February, 2005. The main interlocutors were Alan Churchill and Richard DeVenezia. St�phane. ----Message d'origine---- >Date: Wed, 4 May 2005 04:03:18 GMT >De: Josh Grameson <moon248@BORDERLESSGROUP.COM> >Sujet: Re: SAS & .Net ?? >A: SAS-L@LISTSERV.UGA.EDU > >Thanks so much for your reply. > >Well it's a collection of apps in SAS that returns various number analysis >based o...

Calling third party C library functions from C++
Hello All, I have searched internet and also posts on this group. None of the suggestions have worked in my case. I am having linker issues when I try to use a C funtion in C++ code. Though I have declared that C function as extern "C" c_func(......) in my .cpp file. Also this c_func takes argument as (void*, void (cpp_func*)(int, void*, unsigned long), void*) Here cpp_func is a pointer to a function in my .cpp file(not a member function) where I am calling this c_func To avoid name mangling by C++ compiler for the function to which cpp_func points to I have also declared this...

Re: R vs. SAS (was Replacement for SAS (SPSS vs. SAS, redux)) #2
Sounds like R is the SAS equivalent of Linux .. who are incidentally in all sorts of a copy left/right mess at the moment. On Thu, 5 Feb 2004 09:39:37 -0500, Peter Flom <flom@NDRI.ORG> wrote: >I use both SAS and R; I"ve used SAS for 10 or 15 years, R for about 6 >months - 1 year. > >Each has strengths and weaknesses; I'd not like to give up either. > >Strengths of SAS (esp. compared to R) > >Tech support - I have SAS tech support's phone number and our license >number memorized. They're great. > >SAS-L - There's also an R-help list...

How to lock the SAS code from editing?
Hi, there, People work in a server could share SAS code to each other. Sometims, one could accidently change others' code and save it. Is there a way that autho= r could lock the SAS code from editing and still could share it with others? Thank you. JP More details please: * what operating system? * where is the code stored? external files? sas catalog entry? etc. Your question begs the answer "just make the file readonly", but without appropriate details it's difficult to help further. "Jianping Zhu" <zhujp98@GMAIL.COM> wrote in message news:6716d5d0...

windows call createprocess() failed
VO 2.6 SP3 , Win7 PROF 64-bit starting my app direct from VO i get the following message: "Windows call createprocess() failed on starting C:\CAVo26\Bin\meineapp.dbg any ideas what´s wrong here ?? On Fri, 08 Apr 2011 08:41:27 +0200, Eckhard Sallermann <eckhard.sallermann@bur-kg.de> wrote: Hello Eckhard, >VO 2.6 SP3 , Win7 PROF 64-bit > Maybe a good idea to go to VO 2.8... >starting my app direct from VO i get the following message: >"Windows call createprocess() failed on starting C:\CAVo26\Bin\meineapp.dbg >any ideas wh...

SAS ETL
hi, I need to use the ETL for multiple data inputs and multiple data sets.This can be possible in user written code data transform. Can u please tell me how to use the tool properly for the Multiple Inputs and Multiple outputs. Please explain withe steps to follow. I was getting an eroor whenever i use splitter and user written code . User written code can how far be useful. plaese help me SUNNY. praveencbharadwaj@GMAIL.COM wrote: >hi, > >I need to use the ETL for multiple data inputs and multiple data >sets.This can be possible in user written code data transform. >Can ...

Cycle-based or Event-based simulation?
How do we decide which simulation should we go with for a project? I understand in general VCS is cycle-based simulator and Modelsim is Event-based simulator. But even in VCS when we compile VHDL design there is an option to choose the simulation type "Cycle-based" or "Event-based". Best regards, Muthu On Jun 24, 6:19 am, muthu...@gmail.com wrote: > How do we decide which simulation should we go with for a project? Money Features that you feel are important. On Jun 24, 5:19 am, muthu...@gmail.com wrote: > How do we decide which simulation should we go with for a...

US-TX-Round Rock: Reporting Analyst, SAS, SQL, Regression/Correlation analysis (45321432403)
US-TX-Round Rock: Reporting Analyst, SAS, SQL, Regression/Correlation analysis (45321432403) ============================================================================================ Position: Reporting Analyst Reference: SMC01647 Location: Round Rock TX Duration: 1450hrs Skills: Ability to design and implement systems necessary to collect, maintain, and analyze data. Background in statistics. Graphical experience and/or executive summary experience required. JUMP experience. ...

Re: SAS Help #22 678897
Here you go: data test; input var1; cards; 345678 213987654 575854 ; data final; set test; format var1 z10.; run; proc print;run; Thanks and Regards, Asif Syed Senior Developer Performance Management yale New haven Health System This message originates from Yale New Haven Health System. The information contained in this message may be privileged and confidential. If you are the intended recipient you must maintain this message in a secure and confidential manner. If you are not the intended recipient, please notify the sender immediately and destroy this message. Thank you. ...

Macros: expand list inside and
Hey guys, I'm by no means a macro expert but this seems this is much easier in CL, but I don't want to use CL though so please prove me wrong :). It should be easy enough but I can't find an example of how to do it using define-syntax and syntax-rules. What I want is to take a list as an argument and simply expand a list in place inside an and/or expression. Something like this. (and-using-list (list 1 2 3)) => (and 1 2 3) => 1 I tried this using recursive macros but I wasn't impressed. I think what I need is a way to match a list instead of just matching the () in a ...

Searching for SAS Programming Tips: A Guide to Efficient SAS Programming
Hi, I have 9.1.3 SAS help lists a particular reference "SAS Programming Tips: A Guide to Efficient SAS Programming". I tried searching for this in SAS help but with no success. Using the search button returned 9 entries but none of them has the actual document. Is this resource included in help? Please guide me. Regards, Hari India Hi Hari, Go to Amazon.com and put in that title. It is available there for $12.48 (U.S. dollars). Regards, Barb US - Michigan On Wed, 7 Dec 2005 08:38:48 -0800, Hari <excel_hari@YAHOO.COM> wrote: >Hi, > >I have 9.1.3 > >SAS...

Re: SAS-L Survey #2
Andrea, I don't know why netscape wouldn't accept the address. I did receive the email which you posted to sas-l and your response has been counted. If anyone else runs into the same problem, please use my other email address, namely: atabachneck at ibc dot ca Thanks, Art ----- On Mon, 11 Dec 2006 15:29:15 -0500, Wainwright, Andrea <andrea.wainwright@CAPITALONE.COM> wrote: >Not sure if this has to do with your lower response rate, or if it is >just me, but my reply to you alone bounced back with the following error >message: > >The following message to <art...

error while calling function from external c++ dll
Hi all, I am trying to use a c++ dll from Matlab. For this I am using mex file "me6k.cpp". There is no error on compilation (command for compilation...."mex me6k.cpp"). But when I call this function (by "me6k" command), I get an error in a small new window. Content of this window is as "the specified module could not be found " and window has the name "DLL-error". When I click OK button on this window, the output in command window of Matlab comes as follows ////////////////////// hii...in gaurav hwnd pointing to a window lib loaded function ...

bootstrapping with SAS
Hi I'm reading some new stats books from work and I would like to look at some examples of SAS code and datasets where bootstrapping has or could be applied and the benefits that have been derived from this method. Thanks. DG Search the SUGI proceedings for applications of bootstrap in SAS. There are a number of bootstrap macros that have been referenced over the years; look at the comp.soft-sys.sas in google-groups. Doc Muhlbaier Duke "dg" <queanbeyan@hotmail.com> wrote in message news:417b675d$0$9011$afc38c87@news.optusnet.com.au... > Hi > > I'm r...

convertion from green screen to web based
Hello to everyone: I am in the process to develop my own ASP/D3 solution for a client's intranet, and I would like to know your comments/advices about differences between green screeen and web based interfaces. What I want to do is to keep all my basic programs as 'bussines rules', changing just the user interface. So, what about: - Field validation: Is there a way to perform a field by field server side validation without having to send the whole form with the submit method ? - Mv fields In VB you can insert the content of a text box into a grid to put mv ...