Welcome to GOFASTMOTORSPORTS.com ... ... ... Green Flag - Green Flag - Go Go Go ... ... Brought to you by Ricks Satellite - Where the Big Dish Rules!

Ricks Satellite Forum Header Ad
This Forum is Brought to you by "Ricks Satellite"
www.RicksSatelliteUSA.com or www.GoFastMotorsports.com or call 816-228-1801
Your US Supplier for Free To Air Digital Receivers, Feed Horns, LNB's & LNBF's, Venture Made in the USA Actuator Arms and many other products!

"Coming Soon... The NEW SX88 Octagon H.265 HEVC HD DVB-S2 Multistream Satellite Receiver!"
Ricks Satellite Wildfeed and Backhaul Forum
Register Latest Topics
 
 
 


Reply
  Author   Comment   Page 1 of 10      1   2   3   4   Next   »
bluzee

Registered:
Posts: 2,240
Reply with quote  #1 
Whom ever wrote that IP Cleaning program...   Thanks for that.  Works quite well.   I've realized it will read from a FIFO.  So don't have to dump the whole TS to the hard drive to process.  I dump the TS to a FIFO and have it read from there.  The only thing written to the drive now is just the cleaned up TV show which gets cleaned more or less in real time or at least as fast as it's being transmitted.   Set it to run on an infinite for loop so as one TV show ends and it stops it will start again if a new TV show starts to stream.

Edit: This thread has been made into the official discussion thread for IPCleaner
photoman76

Registered:
Posts: 9,615
Reply with quote  #2 
What's FIFO?
bluzee

Registered:
Posts: 2,240
Reply with quote  #3 
A FIFO is a named pipe.  Looks more or less like a regular file to apps, but it pipes data from one app to another.
chinesebob

Registered:
Posts: 238
Reply with quote  #4 
Are you doing this in Linux or Windows, if in Linux, where is a Linux version of ipcleaner? If in Windows how do you make a FIFO in Windows?
wejones

Avatar / Picture

Registered:
Posts: 5,776
Reply with quote  #5 
Doesn't FIFO mean "First In First Out" ?  

Anyway, I haven't tried the IPCLEANER thing yet, mainly because I didn't think it was capable of near real time operation.  I thought it was just a file processor, not a stream processor.  But that's neat, if it will process a stream as a file .... if I understand what's being said here...   hopefully there will be more explanation of this.  I'd really like to see something like this integrated into a plugin for TSREADER, but I don't know if that's possible or not.

bluzee

Registered:
Posts: 2,240
Reply with quote  #6 
Yes, I think that is what FIFO stands for.  I'm doing this in  Linux.  I don't have windows.  I think windows does have some sort of named pipe implementation, but I don't think it works the same as in Linux. I don't know how to implement it for windows.

This is the little script I use.  It counts on IPcleaner exiting before the new TV show start to stream.  I'm not sure if it always does though.  Haven't used it all that much as yet. 

Any way, first thing you need is a fifo.  If your not familiar with this you just do...

Code:
$ mkfifo  dump.fifo


or what ever name you want for your fifo.  This is my script

Edit: Please ignore this script.  IPcleaner doesn't work this way. This will record the current file being streamed and that is all. Skip to the end of this thread where mips explains how to do this properly. 


Code:
#!/bin/bash

echo "Looping 11945"
while [ "$(pidof dvbstream)" ]
do
sleep 60
done


for (( ; ; ))

do

/usr/bin/dvbstream -f 11945 -s 20000 -L2 10750 -o 8192 > /media/250/dump.fifo & wine /media/250/IPcleaner.exe /media/250/dump.fifo /media/250/$(date +%F_%R)_11945.mpg -pid=0x0320

sleep 30

done


The first little bit is so I can start it if dvbstream is already recording a show and I want to take off and go somewhere and leave the thing running.  You don't need that in there.   I kept the sleep under a minute so it doesn't write a whole bunch of files if there is just dead air.  It runs until you kill it off. Theoretically it records a show, the stream ends and IPcleaner exits. The loop starts it all over again and it will record if there is another TV show streaming. 

Oh,  and it's the same IPcleaner program. Running with wine as you probably noticed already any way.
bluzee

Registered:
Posts: 2,240
Reply with quote  #7 
The code is messed up a bit.  After 8192 should be a ">" .  Between dump.fifo and wine it's just a "&".
wejones

Avatar / Picture

Registered:
Posts: 5,776
Reply with quote  #8 
Neat.   I keep thinking that I need to put Linux on one of my not too old computers. 

Question...   is 11945.mpg  the file that ipcleaner is outputting and 11945 the input file???


If so, perhaps in Windows, TSREADER could output the stream to a file, and ipcleaner could process it as it is being created, and VLC could be playing the file that's being created by ipcleaner?
   I occasionally have TSREADER save a video stream as a file, and have VLC play it back, almost realtime. Works fine with VLC, and also works with my ROKU HD1000, but some programs won't work on a file that's being created.  For example the Azbox won't play a file being created by TSREADER, or actually it will play it, but only up to the size of the file that existed when I started the Azbox playing, since it first checks the file size and only plays that much. 
  But that brings up another question.  In your Linux script, is the dump.FIFO actually a file that keeps growing or is it just sort of a buffer that's being added to and read, but doesn't grow in size past the buffer size? 
bluzee

Registered:
Posts: 2,240
Reply with quote  #9 
The command line for IPcleaner is

IPcleaner.exe   [input file]  [output file]  -pid=[pid to process]

The input file in this case is the fifo I created.  It is always 0 bytes. Any buffer would just be in ram.  The cleaned mpg file is /media/250/$(date +%F_%R)_11945.mpg.   The $(date +%F_%R) creates a file name with the date and time so it's unique and doesn't get over written.  That is the only data that gets written to the disk.  Dumping the whole TS to the hard drive fills it up fairly quickly.  Then processing it takes time. If there is more than one TV show in the TS dump IPcleaner will only process the first one.  To find the later ones you have to use head and tail to split up the TS file.  End up writing an awful lot of GB back and forth and it's very time consuming. 

dvbstream is just -f [frequency] -s [SR] -L2 [ LO HI ]  -o [ stream to standard out instead of the network ]   and 8192 means dump the whole TS.  The ">"  redirects the standard output to the fifo or a regular file if you so desire.   I use the fifo so it doesn't fill up my hard drive.   Obviously if you need switches or other things to tune dvbstream that would have to go in there too.

You can run IPcleaner on a regular TS dump file as it's being written. It runs until it hits the end and then exits.  You can also play the cleaned mpg file as it's being written. It's the hitting the end and exiting part that becomes a pain.  You have to keep going back and restarting from the beginning. VLC is good at playing a file as it's being written.  Some of the TV shows I've watched came in fast enough to watch the show basically in real time as it was received. 
merkin

Registered:
Posts: 827
Reply with quote  #10 
Quote:
Originally Posted by bluzee
Whom ever wrote that IP Cleaning program...   
That is mips.  Developer of etymonix softreel, also first decoder that allowed us to watch 3d feeds.

Quote:
Originally Posted by bluzee
If there is more than one TV show in the TS dump IPcleaner will only process the first one.  To find the later ones you have to use head and tail to split up the TS file. 
Latest versions have a "sub" (previously "subid") argument.  Check out the readme.
bluzee

Registered:
Posts: 2,240
Reply with quote  #11 
Thanks to mips then.  

I don't see any mention of "sub" or "subid" in the readme. What is the latest version?
merkin

Registered:
Posts: 827
Reply with quote  #12 
Quote:
Originally Posted by bluzee
Thanks to mips then.  

I don't see any mention of "sub" or "subid" in the readme. What is the latest version?
bluzee

Registered:
Posts: 2,240
Reply with quote  #13 
That's the version I'm using.  Still not seeing mention of subid in the readme.  I found where you were discussing it on the HBO thread though.  In that situation did you have two programs being streamed at the same time on the single pid?

What I was referring to is where you have dumped say 8 hours or so of a TS while you were gone and then start to process it. The first couple hours may have a TV show, then some null and perhaps another TV show in the following couple hours of the TS.  IPcleaner will get through the first TV show then hit the null section and stop.  Cut off the first section of the TS until you get past the null and start IPcleaner again and then it will do the second TV show.
mips

Registered:
Posts: 528
Reply with quote  #14 
Here's the latest version with the "sub" argument:

EDIT: Link removed. See http://rickcaylor.websitetoolbox.com/post/IPCleaner-software-Only-Post-File-Updates-Here-5924836 for latest version
merkin

Registered:
Posts: 827
Reply with quote  #15 
Sorry for confusion.  .33 uses the subid (now just "sub" in .35) argument.  The argument was undocumented till .35, but worked great in previous versions also.

I can confirm what you see about ipcleaner stopping when the data is null.  I have had to use the hex editor to erase that section, then everything works fine.  Found this out the hard way when there was a large file that iplceaner would completely ignore because the beginning of the file was null.

To answer the question, not really sure.  If you want to to test the "sub" argument try G28 4140H.
One time the same movie was being streamed (and interleaved) at the exact same time.  One was the mpeg2 version and one was the h.264 version, but for some reason only the mpeg2 was encrypted.

Hope I didnt confuse you.
Previous Topic | Next Topic
Print
Reply

Quick Navigation:

Easily create a Forum Website with Website Toolbox.

Fellow Members, your posts are welcome here! Do not worry about posting everything perfect. Different receivers and LNB's will give you different Frequencies and Symbol Rates. Some set top boxes, PCI cards and USB receivers, Do Not Require all of the same information that others may need. It is not Required to post everything that others may need to tune in a feed. It is just most important to share the find. We can always adjust the Frequency and Symbol Rates and try the various Modulations and FEC's on our own receivers until we get a lock and then give a polite reply with what works for your receiver, as that information might help others as well. We all appreciate the efforts and energy of the Posters!

Thank You for Visiting GOFASTMOTORSPORTS.com - Keep Your Eyes on the Sky and the Track!