DjangoBot: #celery

Oh goody. bug is unassigned

but not closed? :)

Everything might have changed now though. This was in may last yera

it's accepted at least

during triage

also http://code.djangoproject.com/ticket/10751

so most of you guys are django developers also? :) nice

Not me. Stuck in javascript hell :b

well, that's what they pay me for anyway

yikes

sorry mate

i'm working on django projects, but I deserve it, as before recently I was working on the messiest perl project ever (a soup of CGI/mod_perl)

nasty

I've been using django for production development on a few applications for about 18 months now

learned python to use django :P

was SOOO happy to leave PHP behind

hehe, ok. PHP. then you deserve it too

yeah ~7 years of PHP

<3 python

with php and perl, I frequently stumpled upon some really hairy code, but that doesn't happen much in the python world

stumbled

asksol: to clarify, .update and .delete don't call save()/delete() or any signals, the admin multiple delete action is an exception, it loops through the queryset and sends the signals, but does .delete on the qs and not on the objects

apollo13: but I think it did. at some point at least

oh wait it doesn't fire signals either

eeeks, but it logs deletion for every object :þ

django.db.models.query.delete_objects

# Pre-notify all instances to be deleted.

it calls both pre_delete and post_delete

I think, without having read the whole code again

asksol : never quite got finished asking you yesterday if there's a way to add/delete/change periodic tasks after beat starts, and ended up just going through the code to try to figure it out

asksol: indeed, I just looked into admin actions…

stovenator: i sent you a tweet (if @stovenator is you)

oh, haven't looked yet

but it looks like what I want to do won't work anyhow, as the next() function in beat seems to make use of the class attribute "name" and not of an instance attribute

stovenator: you have to restart celerybeat, there's no support for stuff like that yet

it would be nice to have at some point

would be easy to make your own celerybeat though

one that reads configuration from a database for example

yeah, I was thinking of trying to make use of sched perhaps

not sure sched would be a good fit when reading from a database

I actually use sched in celeryd for the eta tasks

I don't want to have to read the config info in at every cycle, so something with an interrupt would be nice

you could re-read the database config when receiving the HUP signal for example. if you also reload it every 5 minutes or so, it would probably work fine

is there a reason why the Task and PeriodicTask classes make use of class attributes, and not instance attributes?

what do you mean?

it takes use of both

or, it always reads from an instance to be exact

it seems to always want to find a task by it's __class__.name

what seems to want that?

possible only the periodictask

not sure, maybe the shelve is pickling them

what is the error?

Couldn't apply scheduled task MyTask of type None

let me reconstruct my class... cause I messed it up doing some code exploration

Given the following code: http://pastebin.com/AnUhAvQd

there's no way to register both tasks

the class name is pulled, and only a single instance can be added

stovenator: you can't do that

you need to make a new class

maybe it could be considered a bug, i'm not sure yet

It would be nice to be able to use the instance

what other message queues can celery use?

stomp and rabbit are the only two supported queues i know of

redis and sql databaes being the other backends

any reason you can't go with rabbit?

it's horrible :(

mqing from like 3 machines eats a core

it hella leaks

permissions are difficult

etc...

rabbit really shouldn't be doing all that much but brokering in most setups i can think of where celery comes to play. ihaven't had any leaks or performance issues

your millege varies, i suppose

can you set a model method to be a task?

or would it loose all context?

otherjacob: have you ever used redis?

heedly: not for celery, but i've heard people having pretty good results

i'm not sure at what scale

heedly: I don't know, but that's not my experience with rabbitmq at all