Converting a .bas file into a .tkn file.

[xxgeek]

Is there a way to convert a .bas file into a .tkn file without using the built in link in the "Run" menu?

I'm trying to do it in a batch file, but haven't figured out the format.

Is it text to asci, or text to binary, or hex?

Anyone know of a method?

[EDIT] - Since my question was answered I've worked to improve the code linked to by tsh73.

It's not perfect yet, but worth posting.

It works, and a user can automatically create the TKN file, copy the DLL's/SLL's and rename the runtime file while placing all the files into c:\Users\USERNAME\Application Data\Just Basic v2.0\Projects\"THE-USERS-Filename\PROJECTNAME.EXE, then it runs the PROJECTNAME.exe to show it exists

The user still needs to create the Projects directory before running this code, and to have a look at the paths in the top few lines . I have provided the Windows 10 most likely path for those who need it, just uncomment it

'attempt at making EXE programmatically
'tsh73 Jan 2019
'edited by xxgeek Dec 31 2020

'CHECK THE BELOW PATHS AND FILES  -  EDIT TO MATCH YOUR OWN  ENVIRONMENT
'This program will not work unless you do this.
LBpath$="C:\Program Files (x86)\Just BASIC v2.0"' - May be "Program Files" for some users
LBexe$="jbasic.exe"
LBruntime$="jbrun2.exe"
DllList$="vbas31w.sll vgui31w.sll voflr31w.sll vthk31w.dll vtk1631w.dll vtk3231w.dll vvm31w.dll vvmt31w.dll"
orig$="C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0"
tkn$ = "C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0DestPath1$fname\"
' #######################################################
'Don't forget to put YOUR USER-NAME in where stated in the above/below few lines
Fullpath$ = "C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0\Projects"
DestPath$="C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0\Projects"
'#     MUST CREATE PROJECTS FOLDER YOUR SELF BEFORE RUNNING THIS PROGRAM
'  ---- For Windows10 users
'orig$="C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0"
'tkn$ = "C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0DestPath1$fname\"
'Fullpath$ = "C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0\Projects"
'DestPath$="C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0\Projects"
' #######################################################


qq$=chr$(34)    '(")
ok=1

'Checking all file location for existing files
res=pathExists(LBpath$)
if res then print " exists" else print " Does not exist - ";LBpath$
ok=ok and res

res=fileExists(LBpath$,LBexe$)
if res then print " exists" else print " Does not exist  - ";LBpath$,LBexe$
ok=ok and res

res=fileExists(LBpath$,LBruntime$)
if res then print " exists" else print " Does not exist  -  ";LBpath$,LBruntime$
ok=ok and res

res=pathExists(DestPath$)
if res then print " exists" else print " Does not exist  -  ";DestPath$
ok=ok and res

if not(ok) then
   print "-----------------------"
   print "Program Aborted - Check your files/folders and Paths!"
   end
end if

'User names their project the name of their .BAS file
input "Enter Your Project Name (no extension):";fname$

'Trim any extension the user rmay have added by mistake.
fname0$=trim$(fname$)
fname$=fname0$
if right$(lower$(fname$),4)<>".bas" then fname$=fname$+".bas"

DestPath1$=DestPath$;"\";fname0$

'Check if user removed any old Project Name the samer.
result = mkdir(DestPath1$)

'Give user a scolding if they forgot!!
if result = 183 then
   print "-----------------------"
   print "Directory ";DestPath1$;" for your Project Name already exists"
   print "Delete it, rename it or change Your Projects .bas filename"
   end
end if

if result <> 0 then
   print "-----------------------"
   print "Directory for a project "
   print "  ";DestPath1$
   print "not created - check your filename"
   end
end if

'######################################
'Here is where we copy your "project name.BAS"
'To a newfile and then feed it to fname$
open orig$;"\";fname$ for input as #orig
open DestPath1$;"\";fname$ for output as #1
print #1, input$(#orig, lof(#orig));
close #orig
close #1
'######################################
'Wait while the above copying finishes up.
call pause  400

' - Uncomment to see if your .bas file loads into notepad
'run "notepad.exe ";DestPath1$;"\";fname$

'LBpath$ = "C:\Program Files (x86)\Just BASIC v2.0"

'#####################################

'Create the TKN file. A good time to cross your fingers :D
RUN LBpath$;"\";LBexe$;" -T -A  ";DestPath1$;"\";fname$

'###################################
#
'User may need to increase this value for large BAS files.
call pause 2000

input "User can Press ENTER once this message appears";dummy$

'Check if TKN file was created in the right folder.
res=fileExists(DestPath1$,fname0$;".tkn")
if res then print " exists" else print " The TKN file was not created - no exist"
ok=ok and res
'No TKN = No Soup for You :D
if not(ok) then
   print "----------------------------------------------------------------------------------"
   print "TKN creation failed"
   print "Re-Read this file to see where you went wrong"
   print "One or more of your paths are incorrect - See Top of Code for paths"
   print "----------------------------------------------------------------------------------"
   end
   end if

'Copy dll's, sll's, and jbrun2.exe to the Project folder
from$=LBpath$;"\";LBruntime$
to$=DestPath1$;"\";fname0$;".exe"

run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$
run "cmd.exe /c copy ";"from$";" ";"to$"

'Give time for the copying
call pause 400
'Tell user the bad news, and to check all their path statements
res=fileExists(DestPath1$,fname0$;".exe")
if res then print " exists" else print "The EXE file was not created - no exis - CHECK PATHS"
ok=ok and res

w$=""
i=0
while 1
   i=i+1
   w$=word$(DllList$,i)
   if w$="" then exit while
   from$=LBpath$;"\";w$
   to$=DestPath1$;"\";w$
   print ,to$
   run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$
wend

'run "explorer ";qq$;DestPath1$;qq$

'This runs the new Project to show it was created ok.
'Comment it out if you don't want it to run.
run DestPath1$;"\";fname0$;".exe"

sub pause mil
   t=time$("ms")+mil
   while time$("ms")<t
   scan
   wend
end sub
'Function to check paths and file sfor existance.
function fileExists(path$, filename$)
 dim info$(0, 0)
 files path$, filename$, info$()
 fileExists = val(info$(0, 0)) 'non zero is true
end function

'Function to check paths for existance.
function pathExists(path$)
'if we need it exist anyway
    'catch error "Directory already exists".
      pathExists = (mkdir(path$)=183)
end function


Here is the original code from tsh73

'paths and filenames. Check them!
LBpath$="C:\Program Files\Just BASIC v2.0"
LBexe$="jbasic.exe"
LBruntime$="jbrun2.exe"
DestPath$="C:\WRK\JB\madeEXE"
DllList$="vbas31w.sll vgui31w.sll voflr31w.sll vthk31w.dll vtk1631w.dll vtk3231w.dll vvm31w.dll vvmt31w.dll"

qq$=chr$(34)    '(")
'" -> ";qq$;"

print "Attempt at making EXE programmatically"
print "  create BAS -> TKN -> EXE"
print

'0) check files/folders
print "0) Checking files/folders"
ok=1

print "LBpath$=",LBpath$
res=pathExists(LBpath$)
if res then print " exists" else print " not exists"
ok=ok and res

print "LBexe$=",LBexe$
res=fileExists(LBpath$,LBexe$)
if res then print " exists" else print " not exists"
ok=ok and res

print "LBruntime$=",LBruntime$
res=fileExists(LBpath$,LBruntime$)
if res then print " exists" else print " not exists"
ok=ok and res

print "DestPath$=",DestPath$
res=pathExists(DestPath$)
if res then print " exists" else print " not exists"
ok=ok and res

if not(ok) then
print "-----------------------"
print "program aborted - check your files/folders!"
end
end if

'1) create BAS file
print
print "1) Create BAS file"

input "Enter file name (no extension):";fname$
'fname$="hello"
fname0$=trim$(fname$)    'base name
fname$=fname0$
if right$(lower$(fname$),4)<>".bas" then fname$=fname$+".bas"
print "BAS file name: "
print, fname$
'make a directory for a project
DestPath1$=DestPath$;"\";fname0$
print "make a directory for a project: "
print, DestPath1$
'goto [copy]
result = mkdir(DestPath1$)
if result = 183 then
print "-----------------------"
print "Directory for a project "
print "  ";DestPath1$
print "already exists - delete it or change your filename"
end
end if

if result <> 0 then
print "-----------------------"
print "Directory for a project "
print "  ";DestPath1$
print "not created - check your filename"
end
end if

print "gathering data for BAS file..."
input "Enter window title:";ttl$
input "Enter message:";msg$
print
print "creating file ";fname$;"..."
' nomainwin
' notice "made EXE"+chr$(13)+"Hello there"
' end
open DestPath1$;"\";fname$ for output as #1
   #1, "nomainwin"
   #1, "notice "; qq$;ttl$;qq$; "+chr$(13)+"; qq$;msg$;qq$
   #1, "end"
close #1
print "created BAS file: "
print, DestPath1$;"\";fname$

call pause 300
print "running file in Notepad (just close it)"
run "notepad.exe ";DestPath1$;"\";fname$

'2) create TKN file
print
print "2) Creating a TKN file"
print "this will leave SAVE TKN dialog"
print "   *Just press ENTER*   "
print "(and on Information box(es) press Ok too)"
'RUN "JBASIC -T -A PROG.BAS"
RUN LBpath$;"\";LBexe$;" -T -A ";DestPath1$;"\";fname$
'this leaves a dialog or two. If one pass ENTER there it will help.
'now, this file is AHK script pressing OK for you
call pause 2000 'may take a while
'RUN "saveTKNok.exe"

input "Press ENTER then ready";dummy$
print ,DestPath1$;"\";fname0$;".tkn"
res=fileExists(DestPath1$,fname0$;".tkn")
if res then print " exists" else print " not exists"
ok=ok and res

if not(ok) then
print "-----------------------"
print "TKN creation failed"
end
end if

[copy]
'3) copy files
print
print "3) Copy necessary files"
'runtime
print "runtime"
from$=LBpath$;"\";LBruntime$
to$=DestPath1$;"\";fname0$;".exe"
'run "cmd.exe /k echo ";qq$;from$;qq$;" ";qq$;to$;qq$
run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$

call pause 300

print , to$
res=fileExists(DestPath1$,fname0$;".exe")
if res then print " exists" else print " not exists"
ok=ok and res

'dll sll
print "DLL / SLL"

w$=""
i=0
while 1
   i=i+1
   w$=word$(DllList$,i)
   if w$="" then exit while
   from$=LBpath$;"\";w$
   to$=DestPath1$;"\";w$
print ,to$
   run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$
wend

print "Folder with project"
print DestPath1$
run "explorer ";qq$;DestPath1$;qq$
print "-=*over*=-"

'-----------------------------
sub pause mil
   t=time$("ms")+mil
   while time$("ms")<t
       scan
   wend
end sub

function fileExists(path$, filename$)
 dim info$(0, 0)
 files path$, filename$, info$()
 fileExists = val(info$(0, 0)) 'non zero is true
end function

function pathExists(path$)
'if we need it exist anyway
'catch error "Directory already exists".
  pathExists = (mkdir(path$)=183)
end function

[code]'Here is the editted code. Again lol, I can't seem to get it right, so I'll leave it instead of making it worse.

'attempt at making EXE programmatically
'tsh73 Jan 2019
'edited by xxgeek

'CHECK THE BELOW PATHS AND FILES - EDIT TO MATCH YOUR OWN ENVIRONMENT
'This program will not work unless you do this.
LBpath$="C:\Program Files (x86)\Just BASIC v2.0" 'May be C:\Program Files for some users
LBexe$="jbasic.exe"
LBruntime$="jbrun2.exe"
DllList$="vbas31w.sll vgui31w.sll voflr31w.sll vthk31w.dll vtk1631w.dll vtk3231w.dll vvm31w.dll vvmt31w.dll"
orig$="C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0"
tkn$ = "C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0\DestPath1\$fname\"
' #######################################################
'Don't forget to put YOUR USER-NAME in where stated in the above/below few lines
Fullpath$ = "C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0\Projects"
DestPath$="C:\users\YOUR USER-NAME HERE\Application Data\Just BASIC v2.0\Projects"
'# MUST CREATE PROJECTS FOLDER YOUR SELF BEFORE RUNNING THIS PROGRAM #
' ---- For Windows10 users
'orig$="C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0"
'tkn$ = "C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0\$fname"
'Fullpath$ = "C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0\Projects"
'DestPath$="C:\users\YOUR USER-NAME HERE\App Data\Roaming\Just BASIC v2.0\Projects"
' #######################################################


qq$=chr$(34) '(")
ok=1

'Checking all file location for existing files
res=pathExists(LBpath$)
if res then print " exists" else print " Does not exist - ";LBpath$
ok=ok and res

res=fileExists(LBpath$,LBexe$)
if res then print " exists" else print " Does not exist - ";LBpath$,LBexe$
ok=ok and res

res=fileExists(LBpath$,LBruntime$)
if res then print " exists" else print " Does not exist - ";LBpath$,LBruntime$
ok=ok and res

res=pathExists(DestPath$)
if res then print " exists" else print " Does not exist - ";DestPath$
ok=ok and res

if not(ok) then
print "-----------------------"
print "Program Aborted - Check your files/folders and Paths!"
end
end if

'User names their project the name of their .BAS file
input "Enter Your Project Name (no extension):";fname$

'Trim any extension the user rmay have added by mistake.
fname0$=trim$(fname$)
fname$=fname0$
if right$(lower$(fname$),4)<>".bas" then fname$=fname$+".bas"

DestPath1$=DestPath$;"\";fname0$

'Check if user removed any old Project Name the samer.
result = mkdir(DestPath1$)

'Give user a scolding if they forgot!!
if result = 183 then
print "-----------------------"
print "Directory ";DestPath1$;" for your Project Name already exists"
print "Delete it, rename it or change Your Projects .bas filename"
end
end if

if result <> 0 then
print "-----------------------"
print "Directory for a project "
print " ";DestPath1$
print "not created - check your filename"
end
end if

'######################################
'Here is where we copy your "project name.BAS"
'To a newfile and then feed it to fname$
open orig$;"\";fname$ for input as #orig
open DestPath1$;"\";fname$ for output as #1
print #1, input$(#orig, lof(#orig));
close #orig
close #1
'######################################
'Wait while the above copying finishes up.
call pause 400

' - Uncomment to see if your .bas file loads into notepad
'run "notepad.exe ";DestPath1$;"\";fname$

'LBpath$ = "C:\Program Files (x86)\Just BASIC v2.0"

'#####################################

'Create the TKN file. A good time to cross your fingers :D
RUN LBpath$;"\";LBexe$;" -T -A ";DestPath1$;"\";fname$

'###################################
#
'User may need to increase this value for large BAS files.
call pause 2000

input "User can Press ENTER once this message appears";dummy$

'Check if TKN file was created in the right folder.
res=fileExists(DestPath1$,fname0$;".tkn")
if res then print " exists" else print " The TKN file was not created - no exist"
ok=ok and res
'No TKN = No Soup for You :D
if not(ok) then
print "----------------------------------------------------------------------------------"
print "TKN creation failed"
print "Re-Read this file to see where you went wrong"
print "One or more of your paths are incorrect - See Top of Code for paths"
print "----------------------------------------------------------------------------------"
end
end if

'Copy dll's, sll's, and jbrun2.exe to the Project folder
from$=LBpath$;"\";LBruntime$
to$=DestPath1$;"\";fname0$;".exe"

run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$
run "cmd.exe /c copy ";"from$";" ";"to$"

'Give time for the copying
call pause 400
'Tell user the bad news, and to check all their path statements
res=fileExists(DestPath1$,fname0$;".exe")
if res then print " exists" else print "The EXE file was not created - no exis - CHECK PATHS"
ok=ok and res

w$=""
i=0
while 1
i=i+1
w$=word$(DllList$,i)
if w$="" then exit while
from$=LBpath$;"\";w$
to$=DestPath1$;"\";w$
print ,to$
run "cmd.exe /c copy ";qq$;from$;qq$;" ";qq$;to$;qq$
wend

'run "explorer ";qq$;DestPath1$;qq$

'This runs the new Project to show it was created ok.
'Comment it out if you don't want it to run.
run DestPath1$;"\";fname0$;".exe"

sub pause mil
t=time$("ms")+mil
while time$("ms")<t
scan
wend
end sub
'Function to check paths and file sfor existance.
function fileExists(path$, filename$)
dim info$(0, 0)
files path$, filename$, info$()
fileExists = val(info$(0, 0)) 'non zero is true
end function

'Function to check paths for existance.
function pathExists(path$)
'if we need it exist anyway
'catch error "Directory already exists".
pathExists = (mkdir(path$)=183)
end function






[tsh73]

TKN is proprietary - in the sense "you don't supposed to know details" - format of Just BASIC.

Liberty BASIC has command line option which make it create TKN, from LB help:
LIBERTY -T -A PROG.BAS Create a TKN file from PROG.BAS then exit

but JB have it not.
(it does accept command but ends up needing user intervention for closing file save dialog )

So there are no official way.
(well, I guess official way is "If you need extra functionality buy Liberty BASIC")

I was able making AHK press that button for me.
This is error prone (depends of other programs, which window has focus etc)
but it was somehow working. Details are in this thread
justbasiccom.proboards.com/thread/223/creating-jb-exe-programmatically

What exactly are you trying to do?
May be there easier ways.

[xxgeek]

First, thanks for the quick response.

What I am trying to do is have a "one click" solution to making an exe file using a batch file. I'm just messing around learning a lot. Getting back on the horse so to speak. I've written quite a few little programs and have them all in a Folder created, and added to when I run my batch script. The script grabs all the dll/sll/jbrun2.exe, then renames jbrun2.exe to the name of "myproject" creates a new folder called Projects\"myproject" when run.
Then opens sfxcreator to make the exe.(also looking at doing this with commandline sfx script)
Hey, maybe I'm lazy but i want to do it all in one click from the "Run" menu when i call my script. The only thing in my way is the making of the tkn file.

I'm not selling these programs or anything of that nature. It's all for personal enjoyment.
I didn't know it was proprietary.
I know I'll figure a way, but I guess I better not post it when I do.

I'll take a look at LB and prog.bas as well, thanks again tsh73

[B+]

Then opens sfxcreator to make the exe.(also looking at doing this with commandline sfx script)

Don't know what that sfxcreator is, and I've only made one Tkn file (not full binary, you can't unless you build a compiler for JB code), but from making that once when COVID on the rise for demo of disease spread to share at another forum, I don't remember any steps that could not be automated? The one that makes it a true stand alone exe doesn't exist. Basically you make a copy of the RunTime and name it your app name and it runs Tkn file a little or allot faster than straight interpreter depending on the code. It's not like you can compile a tiny exe from a tiny bit of code.

[Rod]

It appears we cannot get round the file dialog that saves the created .tkn. To create a .exe package you have a built in tool called Iexpress v2 Just type Iexpress into your Windows search box. It will create a self extracting package. Not automated creation but automated install for end user.

[xxgeek]

I think I'm getting it now. Thanks guys, for all the 'extra' info.
sfxcreator is a small/simple self extractor maker with option for icon emmbedding.
I may look further into 7zip sfx and it's commandline options (not a simple one but doable)

Here's what I have...pre running of my script
I made a folder in c:\users\xxgeek\Application Data\Just Basic v2.0\Projects. I put all the runtime files in there with the .bas and TKN files I make. Also in that path I put sfxcreator.exe

Note: The above path is on my Linux box. Windows uses

c:\users\xxgeek\App Data\Roaming\Just Basic v2.0\Projects

Batch script uses %user% to get around this.

I.
My script gets all the files, renames jbrun2.exe to the TKN name, and makes a new folder using my TKN file name, which changes every time it's run. Then it makes a folder (if not exist) names EXE's Once done sfxcreator.exe is started to make the self extracting exe. and saves the new exe file to EXE's.(I will eventually eliminate this and use commands to automate 7zip self extractor.

Looking at the link tsh73 supplied to his compiler script quickly last night, and it seems there may be a way to create the TKN. Still needs some work though.

If/ when I sort this out, is it ok to post here, or is it a taboo thing around this forum?

I like this forum. I always get good answers and don't want to risk banishment.

P.S. I don't need installers for distribution. I can do that already, and rarely if ever hand out copies of my programs. (all my source code is free) and I'll post anything I have to help anyone else.

Heck, nobody but us programmers seem to care anyway. I just like easy one click solutions and like to keep everything "neat" on my PC.

Thanks again guys/ maybe gals too

[Rod]

The only thing that is taboo is discussions around decompiling a .tkn , decrypting it. Since that isn't what you are about we don't have a problem.

[xxgeek]

Cool, thanks Rod.

I can make the TKN now thanks to the script tsh73 linked to.

I'll trim it down to what I actually need, and repost it later, along with my script, or maybe even make it into one script if I can.

[B+]

Dec 29, 2020 22:36:49 GMT xxgeek said:

Cool, thanks Rod.

I can make the TKN now thanks to the script tsh73 linked to.

I'll trim it down to what I actually need, and repost it later, along with my script, or maybe even make it into one script if I can.

Yeah, sounds good if you can get speedier Tkn's working in a nice clean automatic process.

[Rod]

Just to expand on the .tkn subject a little for other readers. The .tkn file exists primarily to speed the starting of programs. Remember running a program from the editor is a two step process. Firstly the .bas file is “compiled” it is checked for logic flow errors and syntax errors and put into a new token format. These tokens are essentially commands that the runtime engine understands.

If you have a .tkn file you can start it in the editor without the need of the time consuming “compile” stage. So too if you create an .exe package. It is the .tkn file that the runtime executes. Thus an instant start.

Now over time people have adopted the .tkn as an encryption of their program and use it to protect their intellectual rights over the code. It was never designed for this and it is said to be a poor encryption. Poor or not that’s where we are, people assume it is an encryption of their program and get upset if folks start discussing decrypting.

Me? If I wanted my code protected I would use a stronger protection than a .tkn. But since I rarely write anything worth sharing or protecting I stick to .bas

Sharing is more fun anyway.

[xxgeek]

Back for more

I posted the updated code in my first post, and will continue to refine it as time goes by.

I'll work for days just so I don't have to click twice

I screwed up my post at the top, you guys will laugh but I can barely see those lines and thought I didn't post it so I posted again lol

Maybe a mod can go fix it up before I destroy the Board