erdgeist
5174c61a23
If we don't want v6, tell libowfat not to worry about it.
16 years ago
erdgeist
c7ed890222
Fix white spaces
...
Introduce loading tracker states with -l
Alter tracker state to a human readable form
16 years ago
erdgeist
9297967f85
Add a stat option the count bucket stalls
...
Add an iterator for all torrents. It's slower but for stats it's okay.
Move some stats collection stuff to the new iterator. More to come.
Start a "report all stats" page.
Start fixing the code to identify "busy" networks.
Add the concept of hosts allowed to proxy.
Add a parser for the X-Forwarded-For: HTTP header.
Clean up HTTP Header handling code. (Remove some left overs of now vanished sync code).
16 years ago
erdgeist
72a1564ca1
Value of off is not used, so don't calculate it
16 years ago
erdgeist
ff3c0feab5
Add workaround to openbsd's broken v6 API
16 years ago
erdgeist
2d3718151d
Fix a pointer arithmetic issue leading to incorrect peer data being copied. Allocate correct size for debugbuffer. Expect exact values on find keywords, not only prefix match.
16 years ago
erdgeist
0b875273d4
Remove debug message
16 years ago
erdgeist
f12fa4c362
Use a self pipe to wake from io_wait when a thread finished his work.
16 years ago
erdgeist
66c906d5d3
Add comments, rename our struct http_data h to cookie, all clientsockets to sock, all size_t from socket_recvs to byte_count. Make signal handler set default handler for the second SIGINT
16 years ago
erdgeist
02b3abbab6
Make v4 and v6 modes v4/v6-ONLY
16 years ago
erdgeist
131211b4da
V6
16 years ago
erdgeist
779d6c235f
* http and udp routines now use thread local buffers passed in workstruct containers. In other words they do not use static_buffer anymore and are considered to be thread safe.
...
* the new workstruct also introduces a well defined buffer and result passing path
* a new function scan_find_keywords is a wrapper around scan_urlencoded_query that maps keys in url to values passed in an array of ot_keywords structs
* this new function cleans up much of url parameter parsing work, where read_ptr and write_ptr have been introduced rather than the confusing char *c, *data variables
* I now use memcmp instead of byte_diff to allow compiler to optimize constant size string compares
* got rid of UTORRENT_1600_WORKAROUND
* livesync_ticker is now only called from one (currently main) thread to avoid race conditions
16 years ago
erdgeist
8bdc0d73f6
Make opentracker ANSI C again.
16 years ago
erdgeist
2df09905f5
* opentracker now drops permissions in correct order and really chroots() if ran as root
...
* lock passing between add_peer_to_torrent and return_peers_for_torrent is now avoided by providing a more general add_peer_to_torrent_and_return_peers function that can be used with NULL parameters to not return any peers (in sync case)
* in order to keep a fast overview how many torrents opentracker maintains, every mutex_bucket_unlock operation expects an additional integer parameter that tells ot_mutex.c how many torrents have been added or removed. A function mutex_get_torrent_count has been introduced.
16 years ago
erdgeist
5c99e50e25
minoe white space
16 years ago
erdgeist
c6947b160f
Handle program end more politely
16 years ago
erdgeist
ad8c9ee1ef
Avoid cast warning on 64bit machines
16 years ago
erdgeist
08c7162783
Renamed OT_FLAG to OT_PEERFLAG to make code easier to read
...
Introduced READ16/32 and WRITE16/32 makros to abstract loading/storing from unaligned addresses away on cpu's that can actually load/store everywhere
Removed all unnecessary memmoves, especially where it only moved 6 bytes in inner loop. I replaced them with WRITE16/32(READ16/32()) makros
16 years ago
erdgeist
334c6e4bbb
The BIG refactoring [tm]. Too many changes to count them. If it doesn't suite you, revert to last version.
16 years ago
erdgeist
daaee855b2
Whitespace fixes
16 years ago
erdgeist
529919ac83
Fix: blacklist and whitelist config option parsing code was the wrong way
16 years ago
erdgeist
06b503a11f
Enable stats restricting config file option
16 years ago
erdgeist
f4283be677
Fix debug output for addresses >127
16 years ago
erdgeist
fae73214af
A new config file option to connect to tcp and udp at once has been added. Also some clarifications have been put into the sample config file.
16 years ago
erdgeist
bca01f4cde
document the new config file feature.
16 years ago
erdgeist
17724dde29
Make ot_try_bind local again. Also dont handle multi cast udp packets in opentracker.c, ot_livesync.c does it by itself.
16 years ago
erdgeist
68b1b8409b
Make scan_ip4_port API more sane, add debug output, be less tolerant when syntax checking command line options
16 years ago
erdgeist
e534db03c6
added live sync code
...
added a config file parser
added tracker id
changed WANT_CLOSED_TRACKER and WANT_BLACKLIST into WANT_ACCESS_WHITE and WANT_ACCESS_BLACK
changed WANT_TRACKER_SYNC to WANT_SYNC_BATCH and added WANT_SYNC_LIVE
added an option to switch off fullscrapes
cleaned up many internal hardcoded values, like PROTO_FLAG,
16 years ago
denis
b637fdcdf3
add missing include on linux
16 years ago
erdgeist
408c5f98ed
Introducing live busy network detection.
17 years ago
erdgeist
c28cf398fd
Introduce some kind of versioning
17 years ago
erdgeist
bee364a6f3
/ can now be redirected to any URL
17 years ago
denis
362a0e052a
[19:19] <eRdgEiSt> Denis: erdgeist ist ein Volltrottel!
17 years ago
erdgeist
828831bbb6
Dont need arpa/inet
17 years ago
erdgeist
fd41161407
Finally split up the opentracker.c cruft into ot_http.c, ot_accesslist.c and just leave in socket handling and parameter parsing
17 years ago
denis
0a1cc18358
add scrape stats and small correction to udp stats
17 years ago
erdgeist
ae1863f232
Encforce setting the clock more often. This hopefully fixes a rare bug of g_now not being updated anymore.
17 years ago
erdgeist
09a662dfce
Missed the second strnstr... fixed.
17 years ago
erdgeist
54560fdcd3
strnstr is not part of what posix conform libc has to offer... replace it by strstr after cutting off the last byte
17 years ago
erdgeist
b1c8723609
Introducing compression for fullscrapes and tpbs stats
17 years ago
erdgeist
e65ac51a28
Last user of sendmmapdata is gone. Purge it.
17 years ago
erdgeist
cf8d4fae1d
Sockets do not inherit non-blocking state in libowfat...
17 years ago
erdgeist
49ba269b9d
Cleanup now moved to its own thread, too
17 years ago
erdgeist
8d5f221785
Full scrapes are now being delivered in different modes, as triggered by stats&mode=tpbs
17 years ago
erdgeist
6458a37d82
introducing multithreaded full scrape creation.
17 years ago
erdgeist
e476006019
Move dead socket handling from handle_(read,write,timedout) into its own function handle_dead
17 years ago
erdgeist
697e239027
Moving accesslist stuff to its own object
17 years ago
erdgeist
a8993b8eea
Moving full scrapes to iovec-creating thread safe function
17 years ago
erdgeist
927ac023ce
The expensive DMEM stats is gone. No need for it, too much potential to DOS.
17 years ago
erdgeist
41120f6a0d
Move stats out of opentracker.c, also have an own file handle udp requests.
17 years ago
erdgeist
8900cc0dd9
No one can get access to buckets now without locking them. Also split up the trackerlogic.c-monster in functional sub-units. HEADS UP: this code is untested and not considered stable.
17 years ago
erdgeist
a859ae78e5
Cleaned up stats return format. Also reflect APPI changes due to MT code in trackerlogic.{c,h}
17 years ago
erdgeist
8acc0ff48f
Introduce configuration dependent number of parameters in a nicer way
17 years ago
erdgeist
5aa41e9d82
The last experiment failed. No more accept deferral
17 years ago
erdgeist
d276addb7a
Trying to accept connections only when data has come in. This is an experiment.
17 years ago
erdgeist
853dc33be2
Allow for more than one admin ip address
17 years ago
erdgeist
dc8e889797
Add more full scrape stats
17 years ago
erdgeist
31eada6168
Reenabled syncing
17 years ago
erdgeist
b19bbd6a85
Number of buckets is 1024 now
...
Clean all torrents now only cleans one bucket at a time
All torrents that are being worked upon in an announce are being cleaned on demoand
torrent's peer lists now keep extra counts for seeds and peers to speed up scrape and announce
Sync has gone for now. I will think up a new way to implement. The old one was way to slow.
17 years ago
erdgeist
ab9246618b
some clients chose to accidently send negative numwants
17 years ago
erdgeist
1fce733ea0
Accept clients that forget to spell announce at all...
17 years ago
erdgeist
69c6e2bc99
This uTorrent/1600 client requires some... measures :/ I dont like the workaround.
17 years ago
erdgeist
ac57c3d5d6
Now measure the time a clean_all_torrents takes
17 years ago
erdgeist
6876e16242
assume anything looking like GET /a to be an announce...
17 years ago
erdgeist
3aa286d9b8
Last fix was not enough to get rid off those 1600er buggers.
17 years ago
erdgeist
00972c6c68
Work around the stupid utorrent 1600 bug. That'll be removed after a while.
17 years ago
erdgeist
0de8b53fdd
Now the Holzhammer: GET /an is announce, GET /sc is scrape. Period.
17 years ago
erdgeist
6b2307015f
now accept more classes of announce fuckups
17 years ago
erdgeist
42210450f3
Just one more typo
17 years ago
erdgeist
2cbb480865
Just one more typo
17 years ago
erdgeist
886421d2d5
Work around more typos that might end up in torrent files as announce urls
17 years ago
erdgeist
2b715b89f1
Debug code sometimes copied too much data
17 years ago
erdgeist
ddd85ec7e0
Fixed one leak from struct_http
17 years ago
erdgeist
8098adb48e
Be even more stupidistas-tolerant
17 years ago
erdgeist
84f8738b82
Fix debug output
17 years ago
erdgeist
d768bf6e81
Enable _DEBUG_HTTPERROR to avoid warning...
17 years ago
erdgeist
53bce09735
Include time since startup in full scrape debug output
17 years ago
erdgeist
c59e44ba94
Now limit full scrape to requests sending exactly "GET /scrape HTTP/"
17 years ago
erdgeist
41019c79d8
Introducing multiscrape
17 years ago
erdgeist
d5876ebb6b
Prevent url-decoding for debug by using a temp buffer
17 years ago
erdgeist
271ff156ec
Those stupid "announce ?info_hash" torrents get really annoying. Fix it in announce and scrape.
17 years ago
erdgeist
1b0859411e
be more verbose about what full scrape consumers deliver in their http requests
17 years ago
erdgeist
714ea1b88e
give opentracker the missing header file
17 years ago
erdgeist
f56e40c24e
Must not dealloc mmaped buffers with free()
17 years ago
erdgeist
d25cf9307e
Fix misunderstandig of what libowfat thinks are seconds and what I did...
17 years ago
erdgeist
e1f122f7d1
Since array and io_batch are in a union, and we also have time-outing writable sockets, we need to mark, which of the union is used. Also remove the blessed flag from struct http, since its rarely used and can be done in a seperate memcmp.
17 years ago
erdgeist
6eb441d8a0
Cannot access members after they are freed :/
17 years ago
erdgeist
b86e6382a1
Save a lot of work when skipping through uninteresting http request parameters
17 years ago
erdgeist
32f17413fa
Increase send timeout. Also use an own variable for that.
17 years ago
erdgeist
28de135098
io_timeout is absolute, not relative :/
17 years ago
erdgeist
d1c57d90dd
Free iobatches on timeout
17 years ago
erdgeist
8e78ac7012
HEADS UP: you need to check out the latest libowfat! Huge allocations are now taken from mmap()ed regions, not from heap anymore
17 years ago
erdgeist
1e6b48cbc0
Sockets we write to now do also timeout
17 years ago
erdgeist
28d88e3380
Exclude empty torrents from full scrape, also try to shrink full scrape buffer after it is full
17 years ago
erdgeist
3dc470d672
fixed line breaks in log
17 years ago
erdgeist
65cc45f129
Log all expansive operations to stderr
17 years ago
erdgeist
ffffd80719
Most open trackers do not have the problem of not being called often enough.. so do not introduce an extra timeout when waiting for activity. That also removes one of the last extraneous gettimeofday calls
17 years ago
erdgeist
6c1adb8fc8
since gettimeofday is rather expansive, we do only fetch time once in a 5 second period, when we are delivered a SIGALRM.
17 years ago
erdgeist
4c15dc7a70
make 64bit safe
17 years ago
denis
0d36a8754e
fixed some stat output
17 years ago