Azure Stream Analytics SU % Utilization keeps increasing -


i using stream analytics simple data pass-through scenario.
job has multiple sql server outputs (three) , 1 eventhub input. event count small. problem su % utilization keeps increasing. temporary solution restart job once or twice day.

am doing wrong? below sample of query. tried change queries use tumblingwindow, got same result.

select field_1, field_2, field_3, field_4, field_5 [out-alias-1] [in-alias] field_1 'event1:%' or field_1 'event2:%';  select field_1, field_3, field_6, field_7, field_8 [out-alias-2] [in-alias] field_1 'event3:%' or field_1 'event4:%';  select field_1, field_3, field_4, field_9, field_10 [out-alias-3] [in-alias] field_1 not 'event1:%' , field_1 not 'event2:%'   , field_1 not 'event3:%' , field_1 not 'event4:%';

you may observe baseline su % utilization few or without input events, because system consumes amount of resource. amount of resource consumed system may fluctuate on time.

streaming units (sus) represent resources , power execute azure stream analytics job. sus provide way describe relative event processing capacity based on blended measure of cpu, memory, , read , write rates. each streaming unit corresponds 1mb/second of throughput. details, stream analytics key concepts.

the su % utilization metric indicator need scale azure stream analytics job. high su % utilization may result of large window in query, large events in input, large out of order tolerance window, or combination of above. partitioning query, or breaking down query more steps, , adding more sus scale tab both strategies avoid such condition. details, see scale azure stream analytics jobs.


Comments

Post a Comment

Popular posts from this blog

toolbar - How to add link to user registration inside toobar in admin joomla 3 custom component -

im trying write component admin side , need add user creation. dont want duplicate existing codes add link. know how add task not simple link toolbar. thx help. if wanting button opens new user screen can try in component: $bar = jtoolbar::getinstance('toolbar'); $bar->appendbutton('link', 'users', 'new user','index.php?option=com_users&task=user.add'); you need add view.html.php file wherever you're creating toolbar. is need?
Read more

linux - disk space limitation when creating war file -

i have 1 gb disk space limitation hosting app , have used 700mb of it. however want create war file directory big (around 600mb) using command : jar -cvf root.war folderpath that's why encounter quota limitation , can't following. i'm looking way delete folder content when it's applying archive conserve disk space take note can't install zip tool in ssh shell ~ the code works on test directories, test first anyway, deletes files. it's not efficient. assumptions: 300mb free space, in destructively compress 600mb folderpath directory. none of files big -- if file in folderpath 300mb or larger, fail. notes: if ' $out ' file exists, nothing. first find pipes file list while , if ' $out ' doesn't exist in loop, create it, don't update -- if does exist, update it. each pass adds 1 more file, deletes unless file directory. after loop finishes delete empty directories too. unset u ; in=folderpath ; out=roo...
Read more