Welcome to GOFASTMOTORSPORTS.com ... ... ... Green Flag - Green Flag - Go Go Go ... ... Brought to you by Ricks Satellite - Where the Big Dish Rules!

Ricks Satellite Wildfeed and Backhaul Forum
Register Latest Topics
 
 
 


Reply
  Author   Comment   Page 5 of 9     «   Prev   2   3   4   5   6   7   8   Next   »
bluzee

Registered:
Posts: 2,183
Reply with quote  #61 
Yes, that works.  Selected PMT, PCR and data PID and hit the demux button.  Opened up IPcleaner using dvr0 as infile.  Started spitting out files right away.
updatelee

Avatar / Picture

Registered:
Posts: 3,107
Reply with quote  #62 
nice, if you want I can make a button for ipcleaner. If you think thats something users would want.

edit: missed your post on the previous page.

can you send me the command line you use and it'll be easy to add.

__________________
TBS6925/5980, Prof 7301/7500/8000, Genpix Skywalker-1, Skystar 2 Express HD
Hauppauge 950Q/Aero/Aero-m, Kworld 330U/435v3/445v3

I use Linux and support open source projects
Download my opensrc projects at http://updatelee.blogspot.com
mips

Registered:
Posts: 529
Reply with quote  #63 
Quote:
Originally Posted by bluzee
Naming files .bin is the same as naming them .exe.  mime type is application/octet-stream. No file previews in file manager. 


I found .ts to be misleading because the output could be audio only, a program stream, MXF data, weather data, etc, so I went with .bin thinking about generic binary data (until the data format gets identified), but I'm open to suggestions if .bin causes confusion with executables.

Other possible choices:
.stream
.unknown
.content
.tmp
.out

I'm leaning towards one of the first two, but other suggestions are welcome.
bluzee

Registered:
Posts: 2,183
Reply with quote  #64 
.stream actually works really well.  Better than .ts  .ts gives me file previews of mpeg, .stream so far I see file previews of txt files, jpg, bmp, and mpg.  Pretty much the whole lot.  It's not globbed to any mime type as far as I can see nor are any of the other 5.  .ts is globbed to video/mp2t so that's why it makes previews for mpg files only.
mips

Registered:
Posts: 529
Reply with quote  #65 
All right, if there are no objections by tonight, I'll change the default output extension to .stream.
bluzee

Registered:
Posts: 2,183
Reply with quote  #66 
Thank you mips.  I realize it probably doesn't make much difference in Windows, but having file previews while dumping the stream lets me see what is crypt and what is not without having to try and play the file. Also let's me know when files are done downloading so I don't shut the whole process down right in the middle of a really good movie.
midwestmac

Registered:
Posts: 2,231
Reply with quote  #67 
If some want to try it. Here's a screen shot of what mine looks like in linux. I have ipcleaner and clean_ts_dump on my desktop.
Then I go to a terminal, change directory to the desktop. Use the bash ./ command with clean_ts_dump and type the transponder and pid I wantScreenshot from 2014-01-16 22:46:29.png 

cd Desktop

~/Desktop$ ./clean_ts_dump 11942 800

This is all done from the terminal.
The streams will pop up on the desktop then you wait for some A/V streams
You'll need a driver for your satellite card, dvbstream and wine installed


__________________
Azbox Ultra, Pansat 2500, Prof7301,Tbs 6925,5980, Genpix 8psk card, Dektec 2137c, Hauppauge 950q
andyinyakima

Avatar / Picture

Registered:
Posts: 1,519
Reply with quote  #68 


OK, I posted this to another thread in this forum..... I'm lost

What message do I go to in this thread to find out how to implement this.

IPcleaner only runs in Windows so I have to run it wine on Linux???
Is there a chance a Linux version can be written?

Can the script be incorporated into a program?

I'm still trying to get my head around this.

What satellite and transponder do you find you most use (Ku please)?

[confused]

Thanks!

I think if I understand this I might have a better chance with GSE.

There's a lot of knowledge in this thread.

__________________
andyinyakima
-----------------------------------
Recs: TBS6983, TBS5925 __ Ant: 90cm on SG6100__OSes: Linux with v4l-updatelee drivers __ RPi2 with v4l-updatelee drivers

Open Book, Open Source, You have to Open it to Know what's in it!
bluzee

Registered:
Posts: 2,183
Reply with quote  #69 
IPcleaner runs under wine in Linux, so you need to install that. 

There isn't much to this.  Only difference between this process and what you would do in windows is you can skip writing the raw stream dump to a file.   In linux the stream can be piped directly into IPcleaner.   I use dvbstream to tune the transponder and filter the PID onto  a FIFO  which IPcleaner reads and processes.   There is a hard limit of 128 stream processes in IPcleaner. It will dump 128 files then it just stops writing until you restart.

The scripts just automate the process.  Give the tuning and pid parameters to the script and it creates the FIFO, starts dvbstream and then starts IPcleaner.  When you stop  it sorts the files by type and gives them a unique name, then exits. 

I have a second script which runs the first script in an infinite loop.  Give it tuning and pid parameters and it starts the first script.  It then wakes up once a minute and checks to see if the 128 stream file is present and if there is no longer any data being written to the files.  If both are true it restarts the process.

Given my limited skills that's about the best I've managed so far.  To build it all into an app you would need to have MIPSes knowledge of the data streams to know how to clean them and some have coding skills to write an app.   That is not me.

There is a Ku transponder up most of the time on AMC 1 11945 V 20000  PID 800.   Most of the files dumped are PGP encrypted, encrypted otherwise or porn.   Not a lot of regular TV or movies.   The one I monitor is C Band.
midwestmac

Registered:
Posts: 2,231
Reply with quote  #70 
Andy you could try this one AMC21 @ 125w 12120 H 30000 S2/8psk 5/6  and look for pid 2001
I can't check right now but there will be a null pid "8191" and maybe pid "2001" record that pid "2001".

Here's the post on that one I learned a ton from Wejones looking at this stuff and using a hex editor and am still learning.
You don't have to clean all the ip streams up with a hex editor but this particular one we did.
http://rickcaylor.websitetoolbox.com/post/amc-21-iptv-6528962?&trail=75

Sometimes the trick in recording is to start recording right before the program starts. If there is one.
Then sometimes certain streams might be encrypted and ipcleaner can't clean anything.
Thats why bluzee script works good is because its constantly recording up to 128 streams (within one PID)
Some Pids could or might just have 1 or 2 streams pumping out.


__________________
Azbox Ultra, Pansat 2500, Prof7301,Tbs 6925,5980, Genpix 8psk card, Dektec 2137c, Hauppauge 950q
midwestmac

Registered:
Posts: 2,231
Reply with quote  #71 

I should add though in linux if you have ipcleaner and bluzze's scripts in the same folder for that particular one
On mine from the terminal would look like this
$:~/<folder where ipcleaner and script is?>./clean_ts_dump 12120 2001

Edited that[smile] forgot a line" _"


__________________
Azbox Ultra, Pansat 2500, Prof7301,Tbs 6925,5980, Genpix 8psk card, Dektec 2137c, Hauppauge 950q
mips

Registered:
Posts: 529
Reply with quote  #72 
Quote:
Originally Posted by andyinyakima

Is there a chance a Linux version can be written?


Since IPCleaner is currently a stand-alone console app with few calls to the Windows API, it shouldn't be too hard to port to Linux. However, given that you can already use it with Wine on Linux, I'm not sure it would be a worthwhile time investment...

Is there a specific reason why a Linux version would be useful?

bluzee

Registered:
Posts: 2,183
Reply with quote  #73 
I suppose one thing is if it was Linux native then it could be compiled to run on ARM.  You could set up a Matrix or something with a Prof 7500 and use IPcleaner on it.  Wine can't run x86 apps on ARM. 

A linux native app could probably read direct from the dvr device so you could skip the FIFO.

Minor points.  It works as is.  It's quite stable. I've had it running for days at a time.   Yesterday it spit out a couple 35GB files perfectly.   I had to delete them right away because the license that played at the start of the file said it was illegal to receive them, but I thought 35GB was pretty special.
andyinyakima

Avatar / Picture

Registered:
Posts: 1,519
Reply with quote  #74 
Quote:
Originally Posted by midwestmac

I should add though in linux if you have ipcleaner and bluzze's scripts in the same folder for that particular one
On mine from the terminal would look like this
$:~/<folder where ipcleaner and script is?>"./clean_tsdump 12120 2001"



I have wine and IPcleaner which resides at /home/wine/.wine/drive_c/IPcleaner.exe

"wine" is the name of my computer because I make "red wine", I have no love of win emulation although it's suppose to be good. I really wish there was a Linux version of IPcleaner .. I'll get over it for this purpose.

I don't know what bluzee's script is, I've seen bits and pieces, I believe there's a download site ...
lost address. 

How do you decide which PID?



On a side note I am now looking at.... don't mean I'm understanding.

http://spcomnav.uab.es/docs/conferences/Lei_ICSSC2007.pdf

It has a section that compares MPE and GSE encapsulation protocol



__________________
andyinyakima
-----------------------------------
Recs: TBS6983, TBS5925 __ Ant: 90cm on SG6100__OSes: Linux with v4l-updatelee drivers __ RPi2 with v4l-updatelee drivers

Open Book, Open Source, You have to Open it to Know what's in it!
bluzee

Registered:
Posts: 2,183
Reply with quote  #75 
I just wrote a simple script to automate IPcleaning.  I have a back up archive of them here....

https://bitbucket.org/bluzee/ip_scripts

They are specific to my machine.  Tuning params are setup to work with a version of dvbstream I patched.  So, you'll probably have to make some edits to suit your system.  Read the script, you'll see what it does very easily.

You can find the PIDs sending data with apps like updateDVB, TSreader, dvbsnoop.  For streams that don't need cleaning and can be dumped right onto the dvb0 network interface dvbsnoop is handy because it's easy to see not only the IP address but also the port.
Previous Topic | Next Topic
Print
Reply

Quick Navigation:

Fellow Members, your posts are welcome here! Do not worry about posting everything perfect. Different receivers and LNB's will give you different Frequencies and Symbol Rates. Some set top boxes, PCI cards and USB receivers, Do Not Require all of the same information that others may need. It is not Required to post everything that others may need to tune in a feed. It is just most important to share the find. We can always adjust the Frequency and Symbol Rates and try the various Modulations and FEC's on our own receivers until we get a lock and then give a polite reply with what works for your receiver, as that information might help others as well. We all appreciate the efforts and energy of the Posters!

Thank You for Visiting GOFASTMOTORSPORTS.com - Keep Your Eyes on the Sky and the Track!